00000001:00080000:3.0F:1787893323.958740:0:17163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1787893323.959045:0:17163:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc9c7486540 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:3.0:1787893323.959051:0:17163:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9e2792a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc9c7486600 00000020:00080000:3.0:1787893323.959055:0:17163:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc9e2792e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc8c7eae800 00000020:00080000:2.0F:1787893323.959110:0:17222:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:2.0:1787893323.959182:0:17222:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0F:1787893323.959224:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893323.959251:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893323.959260:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893323.959266:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893323.959270:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893323.959278:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893323.959297:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:0.0:1787893323.959301:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893323.959305:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893323.959311:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2512 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17185 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0F:1787893324.278606:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893324.832646:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893324.832691:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893324.832722:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893324.832788:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481846912 00000100:00100000:0.0:1787893324.832788:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481847168 00000100:00100000:1.0:1787893324.832797:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481846912 00000100:00100000:0.0:1787893324.832797:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481847168 00000100:00100000:0.0:1787893324.832847:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481847040 00000100:00100000:1.0:1787893324.832849:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 169 00000100:00100000:0.0:1787893324.832849:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481847040 00000100:00100000:1.0:1787893324.832858:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2393:x1874741481846912:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893324.832880:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:0.0:1787893324.832887:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481847168:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893324.832927:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd286450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2393:x1874741481846912:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 70us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893324.832935:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 169 00000100:00080000:3.0:1787893324.832943:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893324.832947:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893324.832984:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:1.0:1787893324.832991:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+13:2393:x1874741481847040:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893324.833480:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481847168:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 591us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893324.833535:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:3.0:1787893324.840819:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893324.840860:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893324.840904:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893324.840934:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481847680 00000100:00100000:3.0:1787893324.840943:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481847680 00000100:00100000:3.0:1787893324.841013:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481847552 00000100:00100000:3.0:1787893324.841017:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481847552 00000100:00100000:3.0:1787893324.841041:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 74 00000100:00100000:3.0:1787893324.841052:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2392:x1874741481847680:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893324.841090:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+13:2393:x1874741481847040:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 8099us (8366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893324.841098:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:3.0:1787893324.841121:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2392:x1874741481847680:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893324.841121:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:3.0:1787893324.841127:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 74 00000100:00100000:1.0:1787893324.841128:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2392:x1874741481847552:12345-192.168.202.35@tcp:400:kworker.0 00000100:00080000:3.0:1787893324.841144:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893324.841148:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893324.841155:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2392:x1874741481847552:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893324.841160:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 75 00000100:00100000:0.0:1787893324.841615:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481847424 00000100:00100000:0.0:1787893324.841620:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481847424 00000100:00100000:0.0:1787893324.841655:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:0.0:1787893324.841662:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2392:x1874741481847424:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893324.841704:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2392:x1874741481847424:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 43us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893324.841710:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00080000:1.0:1787893324.842055:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893324.845709:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893324.845733:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893324.845756:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893324.845790:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481847296 00000100:00100000:3.0:1787893324.845799:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481847296 00000100:00100000:3.0:1787893324.845853:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481847808 00000100:00100000:3.0:1787893324.845878:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481847808 00000100:00100000:3.0:1787893324.845907:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481847936 00000100:00100000:3.0:1787893324.845909:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481847936 00000100:00100000:3.0:1787893324.845926:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:3.0:1787893324.845937:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2389:x1874741481847296:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:3.0:1787893324.845963:0:18703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf2241 00000100:00080000:3.0:1787893324.845977:0:18703:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7613000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893324.846019:0:18703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787893324.846172:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+2:2389:x1874741481847296:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 236us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893324.846180:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:3.0:1787893324.846195:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:3.0:1787893324.846203:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2389:x1874741481847808:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:3.0:1787893324.846239:0:18703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf2280 00000100:00080000:3.0:1787893324.846246:0:18703:0:(import.c:65:import_set_state_nolock()) ffff9fc9c74ec000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893324.846268:0:18703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787893324.846319:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+2:2389:x1874741481847808:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 116us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893324.846325:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:3.0:1787893324.846336:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:3.0:1787893324.846345:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2389:x1874741481847936:12345-192.168.202.35@tcp:9:kworker.0 00000020:00000080:3.0:1787893324.846356:0:18703:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf2287 00000100:00080000:3.0:1787893324.846362:0:18703:0:(import.c:65:import_set_state_nolock()) ffff9fc9c74eb800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893324.846383:0:18703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1787893324.846450:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3f229414-7dd1-4cf5-a739-e3375b9be1a7+2:2389:x1874741481847936:12345-192.168.202.35@tcp:9:kworker.0 Request processed in 107us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893324.846466:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00080000:3.0:1787893324.846484:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893324.846487:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787893324.846528:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893324.846629:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893324.846634:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893325.297956:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893326.006558:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493456768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893326.006614:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.010596:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893326.010623:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493456896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893326.010694:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.010737:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493456896 00000100:00100000:3.0:1787893326.010744:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493456896 00000100:00100000:3.0:1787893326.010797:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787893326.010807:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493456896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893326.010839:0:18203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787893326.010884:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493456896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.010891:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787893326.011012:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493456896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893326.011130:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493457024:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011162:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.011188:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c846a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493457536:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011225:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.011244:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493458048:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011265:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.011297:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787893326.011302:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493457152:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011325:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.011342:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493457664:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011365:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.011380:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493458176:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011399:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.011428:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493457024 00000100:00100000:3.0:1787893326.011433:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493457024 00000100:00100000:3.0:1787893326.011463:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787893326.011471:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3630:x1874741493457024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011527:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd285450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3630:x1874741493457024:12345-0@lo:400:kworker.0 Request processed in 57us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.011534:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787893326.011560:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493457536 00000100:00100000:3.0:1787893326.011565:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493457536 00000100:00100000:3.0:1787893326.011590:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493458048 00000100:00100000:3.0:1787893326.011592:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493458048 00000100:00100000:3.0:1787893326.011616:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493458176 00000100:00100000:3.0:1787893326.011619:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493458176 00000100:00100000:3.0:1787893326.011635:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787893326.011643:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493457536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011672:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493457536:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.011678:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787893326.011690:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787893326.011698:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493458048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011735:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493458048:12345-0@lo:400:kworker.0 Request processed in 39us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.011742:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787893326.011755:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787893326.011763:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493458176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011789:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493458176:12345-0@lo:400:kworker.0 Request processed in 28us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.011795:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787893326.011814:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493457152 00000100:00100000:3.0:1787893326.011817:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493457152 00000100:00100000:3.0:1787893326.011839:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787893326.011846:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493457152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011876:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493457152:12345-0@lo:400:kworker.0 Request processed in 31us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.011882:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787893326.011898:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493457664 00000100:00100000:3.0:1787893326.011901:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493457664 00000100:00100000:3.0:1787893326.011925:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787893326.011934:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493457664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.011962:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493457664:12345-0@lo:400:kworker.0 Request processed in 31us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.011968:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787893326.011991:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893326.011996:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893326.011998:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893326.012018:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c846bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493457280:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012048:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.012069:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493457792:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012088:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.012102:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493458304:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012121:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.012136:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787893326.012142:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493457408:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012161:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.012174:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493457920:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012305:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.012330:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493457280 00000100:00100000:3.0:1787893326.012334:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493457280 00000100:00100000:3.0:1787893326.012358:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493457408 00000100:00100000:3.0:1787893326.012362:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493457408 00000100:00100000:3.0:1787893326.012376:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787893326.012383:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493457280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012415:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493457280:12345-0@lo:400:kworker.0 Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.012421:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787893326.012432:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787893326.012439:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493457408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012463:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493457408:12345-0@lo:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.012469:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787893326.012484:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493457792 00000100:00100000:3.0:1787893326.012487:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493457792 00000100:00100000:3.0:1787893326.012532:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493458304 00000100:00100000:3.0:1787893326.012536:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493458304 00000100:00100000:3.0:1787893326.012552:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493457920 00000100:00100000:3.0:1787893326.012554:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493457920 00000100:00100000:3.0:1787893326.012568:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787893326.012574:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493457792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012603:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493457792:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.012608:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787893326.012618:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787893326.012626:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493458304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012650:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493458304:12345-0@lo:400:kworker.0 Request processed in 27us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.012655:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787893326.012665:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787893326.012671:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493457920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012695:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493457920:12345-0@lo:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.012700:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1787893326.012716:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893326.012719:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893326.012720:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893326.012722:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893326.012748:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493457152:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012759:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493457664:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012768:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493458176:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012788:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493457024:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012797:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c846a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493457536:0@lo:400:kworker.0 00010000:00080000:3.0:1787893326.012809:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c8469500 x1874741493458048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893326.012819:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493458048:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012853:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493457408:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012861:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493457920:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012869:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c846bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493457280:0@lo:400:kworker.0 00000100:00100000:3.0:1787893326.012877:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493457792:0@lo:400:kworker.0 00010000:00080000:3.0:1787893326.012885:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb69f80 x1874741493458304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893326.012893:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493458304:0@lo:400:kworker.0 00000100:00100000:2.0:1787893326.013052:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493456768 00000100:00100000:2.0:1787893326.013056:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493456768 00000100:00100000:2.0:1787893326.013087:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787893326.013093:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493456768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893326.013115:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787893326.013153:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493456768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (6538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893326.013161:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787893326.013354:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493458688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893326.013383:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893326.013407:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893326.013411:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493458560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893326.013430:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893326.013452:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493458688 00000100:00100000:2.0:1787893326.013456:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493458688 00000100:00100000:2.0:1787893326.013475:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493458560 00000100:00100000:2.0:1787893326.013478:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493458560 00000100:00100000:2.0:1787893326.013510:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787893326.013518:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493458688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893326.013529:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787893326.013558:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493458688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893326.013563:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787893326.013575:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787893326.013581:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493458560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893326.013597:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893326.013631:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493458560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893326.013637:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787893326.013653:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893326.013673:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493458560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893326.013684:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493458688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893326.013718:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493456768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893326.013729:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893326.013734:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493458432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893326.013758:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893326.014166:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493458432 00000100:00100000:3.0:1787893326.014171:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493458432 00000100:00100000:3.0:1787893326.014204:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787893326.014223:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493458432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787893326.014244:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787893326.014277:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493458432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.014283:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787893326.014343:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493458816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893326.014368:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893326.014399:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493458432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893326.014527:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493458816 00000100:00100000:3.0:1787893326.014532:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493458816 00000100:00100000:3.0:1787893326.014567:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787893326.014574:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493458816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893326.014585:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787893326.014819:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493458816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 246us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893326.014826:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787893326.014855:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493458816:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787893326.066620:0:17220:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787893326.066629:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893326.066649:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787893326.066656:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787893326.325584:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893327.084860:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893327.086424:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481848064 00000100:00100000:0.0:1787893327.086437:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481848064 00000100:00100000:2.0:1787893327.093589:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:2.0:1787893327.093607:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+13:15597:x1874741481848064:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787893327.093905:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+13:15597:x1874741481848064:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 Request processed in 303us (9054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893327.093914:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00080000:3.0:1787893327.093992:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893327.101263:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893327.102035:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481848192 00000100:00100000:0.0:1787893327.102047:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481848192 00000100:00100000:0.0:1787893327.102180:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:0.0:1787893327.102192:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:15597:x1874741481848192:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787893327.102314:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:15597:x1874741481848192:12345-192.168.202.35@tcp:60:lhsmtool_posix.0 Request processed in 125us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893327.102330:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00080000:3.0:1787893327.103031:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893327.104724:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893327.104890:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481848448 00000100:00100000:3.0:1787893327.104899:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481848448 00000100:00100000:3.0:1787893327.104964:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:3.0:1787893327.104976:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af98d6ca-b952-492d-ad71-083813d6f146+13:15597:x1874741481848448:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787893327.105225:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af98d6ca-b952-492d-ad71-083813d6f146+14:15597:x1874741481848448:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 251us (507us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787893327.105232:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00010000:00010000:3.0:1787893327.347833:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893328.370403:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893329.393787:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893329.951626:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893329.951659:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893329.951694:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893329.951718:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893329.951740:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893329.951765:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893329.951794:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481848960 00000100:00100000:3.0:1787893329.951816:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481848960 00000100:00100000:3.0:1787893329.951874:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:3.0:1787893329.951896:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481848960:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893329.951966:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481848960:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893329.951975:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:3.0:1787893329.952001:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481848832 00000100:00100000:3.0:1787893329.952004:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481848832 00000100:00100000:3.0:1787893329.952029:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481849088 00000100:00100000:3.0:1787893329.952032:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481849088 00000100:00100000:3.0:1787893329.952047:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481848704 00000100:00100000:3.0:1787893329.952050:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481848704 00000100:00100000:3.0:1787893329.952064:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481849216 00000100:00100000:3.0:1787893329.952066:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481849216 00000100:00100000:3.0:1787893329.952080:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 82 00000100:00100000:3.0:1787893329.952087:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481848832:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893329.952115:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481848832:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 29us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893329.952122:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 82 00000100:00100000:3.0:1787893329.952133:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:3.0:1787893329.952141:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2393:x1874741481849088:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893329.952346:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2393:x1874741481849088:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 205us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893329.952354:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 83 00000100:00100000:3.0:1787893329.952366:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 84 00000100:00100000:3.0:1787893329.952375:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+14:2393:x1874741481848704:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893329.952414:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+14:2393:x1874741481848704:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 41us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893329.952419:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 84 00000100:00100000:3.0:1787893329.952432:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 85 00000100:00100000:3.0:1787893329.952440:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2393:x1874741481849216:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893329.952463:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2393:x1874741481849216:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 25us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893329.952468:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 85 00000100:00080000:3.0:1787893329.952486:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893329.952513:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893329.952516:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893329.952956:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481848576 00000100:00100000:0.0:1787893329.952962:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481848576 00000100:00100000:0.0:1787893329.952998:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 171 00000100:00100000:0.0:1787893329.953006:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2393:x1874741481848576:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893329.953057:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2393:x1874741481848576:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 52us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893329.953063:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 171 00000001:00080000:2.0:1787893330.100529:0:17163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1787893330.100543:0:17163:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:3.0:1787893330.100973:0:17222:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:3.0:1787893330.100985:0:17222:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000001:00100000:1.0:1787893330.111277:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000020:00000080:1.0:1787893330.111288:0:18699:0:(genops.c:885:class_export_put()) final put ffff9fc9c74ea800/3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000001:00100000:1.0:1787893330.111319:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af98d6ca-b952-492d-ad71-083813d6f146 00000020:00000080:1.0:1787893330.111322:0:18699:0:(genops.c:885:class_export_put()) final put ffff9fc8c7613800/af98d6ca-b952-492d-ad71-083813d6f146 00000020:00000080:2.0:1787893330.111648:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c74ea800/3f229414-7dd1-4cf5-a739-e3375b9be1a7 for lustre-OST0000 00000020:00000080:2.0:1787893330.111708:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7613800/af98d6ca-b952-492d-ad71-083813d6f146 for lustre-OST0000 00000020:00000080:2.0:1787893330.111727:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9c74ec000 for lustre-OST0000 00000020:00000080:2.0:1787893330.111732:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7613000 for lustre-OST0000 00000001:00100000:0.0:1787893330.113264:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000020:00000080:0.0:1787893330.113273:0:19518:0:(genops.c:885:class_export_put()) final put ffff9fc9c74e8000/3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000020:00000080:1.0:1787893330.113355:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c74e8000/3f229414-7dd1-4cf5-a739-e3375b9be1a7 for lustre-OST0001 00000020:00000080:1.0:1787893330.113405:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9c74eb800 for lustre-OST0001 00010000:00010000:3.0:1787893330.417680:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893331.121759:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893331.121797:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493458944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893331.121916:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893331.122330:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493458944 00000100:00100000:2.0:1787893331.122340:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493458944 00000100:00100000:2.0:1787893331.122404:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787893331.122416:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493458944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893331.122450:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893331.122526:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493458944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893331.122533:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787893331.122595:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493459072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893331.122623:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893331.122641:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893331.122646:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493459200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893331.122667:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893331.122699:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493459200 00000100:00100000:2.0:1787893331.122703:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493459200 00000100:00100000:2.0:1787893331.122727:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787893331.122734:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493459200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893331.122768:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787893331.122800:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493459200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893331.122806:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787893331.122948:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493459456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893331.122977:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893331.123003:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893331.123009:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493459328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893331.123033:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893331.123058:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493459072 00000100:00100000:0.0:1787893331.123062:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493459072 00000100:00100000:0.0:1787893331.123086:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493459456 00000100:00100000:0.0:1787893331.123088:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493459456 00000100:00100000:0.0:1787893331.123102:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787893331.123109:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493459072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893331.123133:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787893331.123174:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493459072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893331.123181:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787893331.123194:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787893331.123200:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493459456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893331.123217:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787893331.123248:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493459456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893331.123254:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787893331.123301:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493459456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893331.123322:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493459328 00000100:00100000:0.0:1787893331.123326:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493459328 00000100:00100000:0.0:1787893331.123358:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787893331.123364:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493459328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893331.123374:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787893331.123404:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493459328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893331.123409:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787893331.123435:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493459328:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787893331.123692:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893331.123697:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893331.123722:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493458944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893331.123781:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893331.123791:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c846bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493459584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893331.123818:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893331.124071:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493459200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893331.124080:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493459072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893331.124225:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493459968:0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.124256:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893331.124277:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493460480:0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.124303:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893331.124321:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787893331.124326:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493459840:0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.124347:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893331.124363:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493460352:0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.124382:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893331.124407:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493459968 00000100:00100000:1.0:1787893331.124411:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493459968 00000100:00100000:1.0:1787893331.124441:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493460480 00000100:00100000:1.0:1787893331.124445:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493460480 00000100:00100000:1.0:1787893331.124464:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493459840 00000100:00100000:1.0:1787893331.124467:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493459840 00000100:00100000:1.0:1787893331.124476:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493460352 00000100:00100000:1.0:1787893331.124478:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493460352 00000100:00100000:1.0:1787893331.124520:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787893331.124528:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493459968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.124570:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493459968:12345-0@lo:400:kworker.0 Request processed in 43us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893331.124577:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787893331.124591:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787893331.124597:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493460480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.124622:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493460480:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893331.124636:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787893331.124651:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787893331.124656:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493459840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.124682:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493459840:12345-0@lo:400:kworker.0 Request processed in 26us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893331.124687:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787893331.124699:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787893331.124705:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c64b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493460352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.124731:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c64b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493460352:12345-0@lo:400:kworker.0 Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893331.124737:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1787893331.124755:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893331.124758:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893331.124775:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493459840:0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.124784:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493460352:0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.124792:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493459968:0@lo:400:kworker.0 00010000:00080000:1.0:1787893331.124803:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f4380 x1874741493460480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893331.124813:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493460480:0@lo:400:kworker.0 00000100:00100000:0.0:1787893331.125184:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493459712:0@lo:400:kworker.0 00000100:00100000:0.0:1787893331.125216:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893331.125251:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493460224:0@lo:400:kworker.0 00000100:00100000:0.0:1787893331.125270:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893331.125290:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893331.125295:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493460096:0@lo:400:kworker.0 00000100:00100000:0.0:1787893331.125313:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893331.125337:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493460224 00000100:00100000:0.0:1787893331.125341:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493460224 00000100:00100000:0.0:1787893331.125382:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493460096 00000100:00100000:0.0:1787893331.125386:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493460096 00000100:00100000:0.0:1787893331.125405:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787893331.125411:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493460224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893331.125486:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493460224:12345-0@lo:400:kworker.0 Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893331.125512:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787893331.125526:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787893331.125533:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493460096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893331.125559:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493460096:12345-0@lo:400:kworker.0 Request processed in 28us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893331.125564:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787893331.125578:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787893331.125581:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787893331.125597:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493460096:0@lo:400:kworker.0 00010000:00080000:0.0:1787893331.125606:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c76f4000 x1874741493460224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893331.125614:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493460224:0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.125849:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493459712 00000100:00100000:1.0:1787893331.125855:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493459712 00000100:00100000:1.0:1787893331.125891:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787893331.125898:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3631:x1874741493459712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893331.125960:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3631:x1874741493459712:12345-0@lo:400:kworker.0 Request processed in 63us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893331.125967:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787893331.126047:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493459712:0@lo:400:kworker.0 00000100:00100000:3.0:1787893331.126250:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493459584 00000100:00100000:3.0:1787893331.126255:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493459584 00000100:00100000:3.0:1787893331.126345:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787893331.126355:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c843df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493459584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787893331.126370:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787893331.126418:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c843df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493459584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893331.126430:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787893331.126607:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c846bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493459584:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787893331.126663:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787893331.250544:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787893331.441744:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787893332.233899:0:20576:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 01:02:10 (1787893330) 00010000:00010000:0.0:1787893332.470899:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893333.495160:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893334.517487:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893335.066112:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893335.066212:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893335.066254:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893335.066287:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893335.066308:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893335.066335:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893335.066362:0:18703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481849728 00000100:00100000:3.0:1787893335.066372:0:18703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481849728 00000100:00100000:3.0:1787893335.066448:0:18703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:3.0:1787893335.066459:0:18703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481849728:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893335.066577:0:18703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481849728:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 119us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893335.066598:0:18703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:2.0:1787893335.066795:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481849600 00000100:00100000:2.0:1787893335.066813:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481849600 00000100:00100000:2.0:1787893335.066853:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481849856 00000100:00100000:2.0:1787893335.066856:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481849856 00000100:00100000:2.0:1787893335.066870:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481849472 00000100:00100000:2.0:1787893335.066872:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481849472 00000100:00100000:2.0:1787893335.066886:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481849984 00000100:00100000:2.0:1787893335.066889:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481849984 00000100:00100000:2.0:1787893335.066904:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 92 00000100:00100000:2.0:1787893335.066911:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481849600:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893335.066951:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+5:2393:x1874741481849600:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 40us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893335.066958:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 92 00000100:00100000:2.0:1787893335.066972:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 93 00000100:00100000:2.0:1787893335.066978:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2393:x1874741481849856:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893335.067004:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2393:x1874741481849856:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 26us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893335.067010:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 93 00000100:00100000:2.0:1787893335.067022:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 94 00000100:00100000:2.0:1787893335.067028:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+13:2393:x1874741481849472:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893335.067050:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af98d6ca-b952-492d-ad71-083813d6f146+13:2393:x1874741481849472:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 23us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893335.067056:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 94 00000100:00100000:2.0:1787893335.067067:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:2.0:1787893335.067073:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2393:x1874741481849984:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893335.067095:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2393:x1874741481849984:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893335.067110:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 95 00000100:00100000:0.0:1787893335.067974:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481849344 00000100:00100000:0.0:1787893335.067981:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481849344 00000100:00100000:0.0:1787893335.068025:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 173 00000100:00100000:0.0:1787893335.068033:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2393:x1874741481849344:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893335.068077:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2393:x1874741481849344:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 44us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893335.068084:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 173 00000100:00080000:0.0:1787893335.068119:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787893335.068123:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893335.068143:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787893335.537794:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893336.241944:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893336.241972:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493460608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893336.242104:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893336.242410:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893336.242422:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493460736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893336.242471:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893336.242540:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493460736 00000100:00100000:3.0:1787893336.242549:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493460736 00000100:00100000:3.0:1787893336.242606:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787893336.242617:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493460736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787893336.242661:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787893336.242707:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493460736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893336.242714:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787893336.242750:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893336.242781:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493460736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893336.243145:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893336.243156:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493460864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893336.243186:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893336.243264:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493460864 00000100:00100000:2.0:1787893336.243281:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493460864 00000100:00100000:2.0:1787893336.243319:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787893336.243328:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493460864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893336.243346:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893336.243406:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493460864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893336.243413:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787893336.243442:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493460864:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787893336.243631:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893336.243888:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493460608 00000100:00100000:0.0:1787893336.243892:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493460608 00000100:00100000:0.0:1787893336.243920:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787893336.243926:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493460608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893336.243948:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787893336.243989:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493460608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (1885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893336.243996:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787893336.244108:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493461248:0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.244148:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893336.244172:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493461760:0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.244198:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893336.244214:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493462272:0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.244233:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893336.244259:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493460608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893336.244341:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787893336.244347:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493461120:0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.244377:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893336.244398:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493461632:0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.244421:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893336.244435:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493462144:0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.244452:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893336.244479:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493461120 00000100:00100000:0.0:1787893336.244518:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493461120 00000100:00100000:1.0:1787893336.244853:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493461760 00000100:00100000:1.0:1787893336.244856:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493461760 00000100:00100000:1.0:1787893336.244890:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493462272 00000100:00100000:1.0:1787893336.244893:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493462272 00000100:00100000:1.0:1787893336.244917:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493462144 00000100:00100000:1.0:1787893336.244919:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493462144 00000100:00100000:1.0:1787893336.244935:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787893336.244942:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493461760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893336.245000:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493461760:12345-0@lo:400:kworker.0 Request processed in 58us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893336.245008:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787893336.245024:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787893336.245031:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493462272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893336.245061:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493462272:12345-0@lo:400:kworker.0 Request processed in 30us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893336.245067:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787893336.245087:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787893336.245093:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493462144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893336.245134:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493462144:12345-0@lo:400:kworker.0 Request processed in 41us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893336.245140:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1787893336.245162:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893336.245166:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893336.245185:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493462144:0@lo:400:kworker.0 00000100:00100000:1.0:1787893336.245194:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493461760:0@lo:400:kworker.0 00010000:00080000:1.0:1787893336.245205:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c8481c00 x1874741493462272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893336.245215:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493462272:0@lo:400:kworker.0 00000100:00100000:2.0:1787893336.245893:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c843ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493460992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893336.245933:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893336.245958:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493461504:0@lo:400:kworker.0 00000100:00100000:2.0:1787893336.245980:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893336.245998:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493462016:0@lo:400:kworker.0 00000100:00100000:2.0:1787893336.246018:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893336.246034:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493462528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893336.246053:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893336.246072:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787893336.246078:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493461376:0@lo:400:kworker.0 00000100:00100000:2.0:1787893336.246100:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893336.246114:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493461888:0@lo:400:kworker.0 00000100:00100000:2.0:1787893336.246148:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893336.246165:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493462400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893336.246199:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893336.246226:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493461504 00000100:00100000:2.0:1787893336.246231:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493461504 00000100:00100000:2.0:1787893336.246255:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493462016 00000100:00100000:2.0:1787893336.246257:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493462016 00000100:00100000:2.0:1787893336.246292:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493461888 00000100:00100000:2.0:1787893336.246295:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493461888 00000100:00100000:2.0:1787893336.246309:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787893336.246316:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493461504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893336.246359:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493461504:12345-0@lo:400:kworker.0 Request processed in 45us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893336.246365:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787893336.246378:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787893336.246383:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493462016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893336.246409:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493462016:12345-0@lo:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893336.246414:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787893336.246423:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787893336.246428:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493461888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.246719:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787893336.246729:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3631:x1874741493461120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.246773:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3631:x1874741493461120:12345-0@lo:400:kworker.0 Request processed in 46us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893336.246779:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787893336.246810:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493461248 00000100:00100000:0.0:1787893336.246815:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493461248 00000100:00100000:0.0:1787893336.246832:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493462400 00000100:00100000:0.0:1787893336.246835:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493462400 00000100:00100000:0.0:1787893336.246846:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787893336.246852:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493461248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.246885:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3631:x1874741493461248:12345-0@lo:400:kworker.0 Request processed in 33us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893336.246891:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787893336.246902:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787893336.246908:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493462400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893336.246931:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787893336.247010:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493462400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893336.247016:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787893336.247046:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493461120:0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.247058:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493461248:0@lo:400:kworker.0 00000100:00080000:0.0:1787893336.247127:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787893336.247131:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787893336.247142:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493460992 00000100:00100000:0.0:1787893336.247154:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493460992 00000100:00100000:0.0:1787893336.247183:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493462528 00000100:00100000:0.0:1787893336.247186:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493462528 00000100:00100000:0.0:1787893336.247203:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787893336.247209:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493460992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893336.247224:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787893336.247255:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493460992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893336.247260:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787893336.247285:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787893336.247291:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493462528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893336.247301:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787893336.247327:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493462528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893336.247333:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787893336.247346:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893336.247349:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893336.247376:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493461888:0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.247390:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493462400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893336.247404:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c843ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493460992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893336.247416:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493461504:0@lo:400:kworker.0 00010000:00080000:0.0:1787893336.247428:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c8483b80 x1874741493462016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893336.247438:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493462016:0@lo:400:kworker.0 00000100:00100000:0.0:1787893336.247465:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493462528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893336.247718:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493461632 00000100:00100000:3.0:1787893336.247724:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493461632 00000100:00100000:3.0:1787893336.247751:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493461376 00000100:00100000:3.0:1787893336.247754:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493461376 00000100:00100000:3.0:1787893336.247772:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787893336.247778:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493461632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893336.247819:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493461632:12345-0@lo:400:kworker.0 Request processed in 40us (3397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893336.247825:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787893336.247837:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787893336.247842:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493461376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893336.247874:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493461376:12345-0@lo:400:kworker.0 Request processed in 32us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893336.247879:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787893336.247942:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493461632:0@lo:400:kworker.0 00000100:00100000:2.0:1787893336.248029:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493461888:12345-0@lo:400:kworker.0 Request processed in 21us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893336.248038:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787893336.252410:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493461376:0@lo:400:kworker.0 00000040:00080000:0.0:1787893336.306008:0:17220:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787893336.306018:0:17220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893336.306040:0:17220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787893336.306049:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787893336.561872:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893336.823905:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893336.824773:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481850240 00000100:00100000:0.0:1787893336.824785:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481850240 00000100:00100000:0.0:1787893336.824853:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:0.0:1787893336.824864:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af98d6ca-b952-492d-ad71-083813d6f146+13:16360:x1874741481850240:12345-192.168.202.35@tcp:35:umount.0 00000001:00080000:0.0:1787893336.825095:0:17186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1787893336.825193:0:17186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1787893336.825326:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af98d6ca-b952-492d-ad71-083813d6f146+16:16360:x1874741481850240:12345-192.168.202.35@tcp:35:umount.0 Request processed in 462us (1428us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1787893336.825334:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000020:00080000:0.0:1787893336.825339:0:17186:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787893336.833066:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893336.833129:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893336.833163:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893336.833285:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893336.833319:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481850624 00000100:00100000:3.0:1787893336.833329:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481850624 00000100:00100000:3.0:1787893336.833377:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481850496 00000100:00100000:3.0:1787893336.833380:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481850496 00000100:00100000:3.0:1787893336.833391:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481850752 00000100:00100000:3.0:1787893336.833393:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481850752 00000100:00100000:3.0:1787893336.833408:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:3.0:1787893336.833418:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+15:2392:x1874741481850624:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893336.833434:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893336.833456:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541e00/0x9232577658cf2225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab3f expref: 15 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893336.833475:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893336.833584:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+14:2392:x1874741481850624:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 167us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893336.833592:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:3.0:1787893336.833610:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:3.0:1787893336.833617:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+13:2392:x1874741481850496:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893336.833623:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893336.833633:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541c00/0x9232577658cf221e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab0e expref: 13 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893336.834892:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893336.834997:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+12:2392:x1874741481850496:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 1375us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893336.835007:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:3.0:1787893336.835065:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:3.0:1787893336.835090:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:2392:x1874741481850752:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893336.835103:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893336.835129:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c7c7ee00/0x9232577658cf22aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabf5 expref: 11 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893336.835138:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893336.835157:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:2392:x1874741481850752:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 73us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893336.835164:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:0.0:1787893336.835673:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481850368 00000100:00100000:0.0:1787893336.835681:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481850368 00000100:00100000:0.0:1787893336.835726:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:0.0:1787893336.835734:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c846bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af98d6ca-b952-492d-ad71-083813d6f146+5:2389:x1874741481850368:12345-192.168.202.35@tcp:9:umount.0 00000020:00000080:0.0:1787893336.835767:0:18702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf2248 00000100:00080000:0.0:1787893336.835776:0:18702:0:(import.c:65:import_set_state_nolock()) ffff9fc9c74ee800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787893336.835833:0:18702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787893336.835962:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c846bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af98d6ca-b952-492d-ad71-083813d6f146+2:2389:x1874741481850368:12345-192.168.202.35@tcp:9:umount.0 Request processed in 226us (2905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893336.835969:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00010000:00010000:2.0:1787893336.836223:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893336.861429:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893336.861763:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481851648 00000100:00100000:0.0:1787893336.861787:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481851648 00000100:00100000:0.0:1787893336.861853:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:0.0:1787893336.861863:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+16:2389:x1874741481851648:12345-192.168.202.35@tcp:39:umount.0 00000020:00000080:0.0:1787893336.861894:0:17185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf2233 00000020:00010000:0.0:1787893336.861910:0:17185:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc8c75ac000: total 0 00000100:00080000:0.0:1787893336.861915:0:17185:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75ac800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787893336.861945:0:17185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1787893336.862107:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af98d6ca-b952-492d-ad71-083813d6f146+15:2389:x1874741481851648:12345-192.168.202.35@tcp:39:umount.0 Request processed in 245us (691us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1787893336.862125:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000020:00010000:3.0:1787893336.862939:0:17171:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc8c75ac000: total 0 00010000:00010000:3.0:1787893336.862945:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893336.862999:0:17171:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc8c75ac000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787893336.863035:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc9c690b300) 00010000:00010000:3.0:1787893336.863039:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893336.863049:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540c00/0x9232577658cf22fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabfc expref: 14 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893336.863135:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc9c690bc00) 00010000:00010000:3.0:1787893336.863139:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787893336.863144:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7600/0x9232577658cf23de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac3b expref: 13 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893336.863161:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:3.0:1787893336.863164:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893336.863168:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0c00/0x9232577658cf248d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac7a expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893336.863198:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:3.0:1787893336.863201:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787893336.863206:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf245c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac65 expref: 11 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893336.863218:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e5e7c600) 00010000:00010000:3.0:1787893336.863221:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893336.863235:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1e00/0x9232577658cf2359 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac11 expref: 10 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893336.863248:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc9e5e7cb00) 00010000:00010000:3.0:1787893336.863250:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893336.863253:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf254a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facb2 expref: 9 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893336.863268:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc9c690b400) 00010000:00010000:3.0:1787893336.863270:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893336.863273:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541600/0x9232577658cf231a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac03 expref: 8 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893336.863287:0:17171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc9cab65900) 00010000:00010000:3.0:1787893336.863289:0:17171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893336.863292:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7fa00/0x9232577658cf24e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac8f expref: 7 pid: 19990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893336.863305:0:17171:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc8c75ac000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1787893336.863317:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893336.863325:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893336.863327:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893336.873907:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893336.874006:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481851776 00000100:00100000:0.0:1787893336.874017:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481851776 00000100:00100000:0.0:1787893336.874080:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:0.0:1787893336.874090:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+5:2389:x1874741481851776:12345-192.168.202.35@tcp:39:umount.0 00000020:00000080:0.0:1787893336.874132:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf223a 00000100:00080000:0.0:1787893336.874151:0:17183:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75aa800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787893336.874183:0:17183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787893336.874441:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af98d6ca-b952-492d-ad71-083813d6f146+3:2389:x1874741481851776:12345-192.168.202.35@tcp:39:umount.0 Request processed in 351us (542us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787893336.874449:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 68 00010000:00010000:1.0:1787893336.875992:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893337.585818:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893338.609788:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893339.400753:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893339.400872:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893339.403096:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893339.403323:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481851904 00000100:00100000:0.0:1787893339.403337:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481851904 00000100:00100000:0.0:1787893339.403425:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481852160 00000100:00100000:0.0:1787893339.403430:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481852160 00000100:00100000:0.0:1787893339.403453:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:0.0:1787893339.403465:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+11:2392:x1874741481851904:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893339.403486:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893339.403779:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c67e1a00/0x9232577658cf225d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab7e expref: 11 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893339.403806:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893339.403890:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+10:2392:x1874741481851904:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 427us (3153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893339.403899:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:0.0:1787893339.403926:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:0.0:1787893339.403934:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+9:2392:x1874741481852160:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893339.403944:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893339.403955:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31a00/0x9232577658cf22a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabee expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893339.403965:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893339.403984:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:2392:x1874741481852160:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 51us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893339.403990:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:0.0:1787893339.404534:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481852032 00000100:00100000:0.0:1787893339.404541:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481852032 00000100:00100000:0.0:1787893339.404593:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:0.0:1787893339.404601:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+8:2392:x1874741481852032:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893339.404610:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893339.404621:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe540200/0x9232577658cf2264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fabaf expref: 8 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893339.404633:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893339.404655:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf022523-db7f-4c9e-a3ea-97d11e9985e2+7:2392:x1874741481852032:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 55us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893339.404687:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:2.0:1787893339.411780:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893339.411993:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481852416 00000100:00100000:1.0:1787893339.412007:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481852416 00000100:00100000:1.0:1787893339.412169:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:1.0:1787893339.412183:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f229414-7dd1-4cf5-a739-e3375b9be1a7+6:2389:x1874741481852416:12345-192.168.202.35@tcp:39:umount.0 00000020:00000080:1.0:1787893339.412249:0:20187:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf2272 00000020:00010000:1.0:1787893339.412259:0:20187:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc8c7616000: total 0 00000100:00080000:1.0:1787893339.412265:0:20187:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7610800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787893339.412303:0:20187:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:1.0:1787893339.412523:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2389:x1874741481852416:12345-192.168.202.35@tcp:39:umount.0 Request processed in 310us (723us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1787893339.412548:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 69 00000020:00010000:3.0:1787893339.413196:0:17172:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc8c7616000: total 0 00010000:00010000:3.0:1787893339.413265:0:17172:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc8c7616000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787893339.413314:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9e5e7c600) 00010000:00010000:3.0:1787893339.413318:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893339.413329:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c7c7e600/0x9232577658cf2367 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fac18 expref: 4 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893339.413356:0:17172:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc8c7616000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787893339.413368:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893339.413370:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893339.413372:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787893339.415807:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893339.430195:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893339.430592:0:19990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481852544 00000100:00100000:2.0:1787893339.430605:0:19990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481852544 00000100:00100000:2.0:1787893339.430733:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:2.0:1787893339.430746:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+5:2389:x1874741481852544:12345-192.168.202.35@tcp:39:umount.0 00000020:00000080:2.0:1787893339.430800:0:19990:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf2279 00000100:00080000:2.0:1787893339.430812:0:19990:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7615000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787893339.430848:0:19990:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1787893339.431042:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3f229414-7dd1-4cf5-a739-e3375b9be1a7+3:2389:x1874741481852544:12345-192.168.202.35@tcp:39:umount.0 Request processed in 298us (863us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787893339.431064:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00080000:0.0:1787893339.431332:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787893339.431652:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893339.501719:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893339.503567:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481852800 00000100:00100000:3.0:1787893339.503594:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481852800 00000100:00100000:3.0:1787893339.503703:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 175 00000100:00100000:3.0:1787893339.503714:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+7:2389:x1874741481852800:12345-192.168.202.35@tcp:251:umount.0 00000020:00000080:3.0:1787893339.503768:0:17178:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf2210 00000020:00010000:3.0:1787893339.503776:0:17178:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc9d3044000: total 0 00000100:00080000:3.0:1787893339.503781:0:17178:0:(import.c:65:import_set_state_nolock()) ffff9fc8c741f800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787893339.503887:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf022523-db7f-4c9e-a3ea-97d11e9985e2+3:2389:x1874741481852800:12345-192.168.202.35@tcp:251:umount.0 Request processed in 175us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893339.503895:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 175 00000020:00010000:1.0:1787893339.505119:0:17171:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc9d3044000: total 0 00010000:00010000:1.0:1787893339.505226:0:17171:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc9d3044000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787893339.505281:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30000/0x9232577658cf2217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fab07 expref: 2 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893339.505304:0:17171:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc9d3044000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787893339.505316:0:17171:0:(genops.c:885:class_export_put()) final put ffff9fc9d3044000/bf022523-db7f-4c9e-a3ea-97d11e9985e2 00010000:00010000:1.0:1787893339.505343:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893339.505346:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893339.505348:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787893339.506642:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9d3044000/bf022523-db7f-4c9e-a3ea-97d11e9985e2 for MGS 00000020:00000080:3.0:1787893339.506710:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c741f800 for MGS 00010000:00010000:3.0:1787893339.635532:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893340.667721:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893341.364815:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893341.364840:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493462656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893341.364911:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893341.364976:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493462656 00000100:00100000:2.0:1787893341.364984:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493462656 00000100:00100000:2.0:1787893341.365036:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787893341.365047:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493462656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893341.365085:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893341.365129:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493462656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.365136:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787893341.365155:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893341.365187:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493462656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893341.367326:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d29fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493462912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893341.367387:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.367447:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493462912 00000100:00100000:1.0:1787893341.367454:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493462912 00000100:00100000:1.0:1787893341.367521:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787893341.367529:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493462912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893341.367560:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787893341.367602:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493462912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893341.367609:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787893341.367633:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893341.367640:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493462784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893341.367666:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.367692:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493462784 00000100:00100000:1.0:1787893341.367707:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493462784 00000100:00100000:1.0:1787893341.367736:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787893341.367743:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493462784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893341.367760:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787893341.367805:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493462784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893341.367811:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787893341.367848:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fe349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493462784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893341.367875:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d29fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493462912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893341.368180:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493463296:0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.368216:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893341.368254:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493463808:0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.368279:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893341.368308:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493464320:0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.368333:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893341.368354:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787893341.368359:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493463168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893341.368378:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893341.368394:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493463680:0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.368414:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893341.368431:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493464192:0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.368452:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787893341.368477:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893341.368511:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493463296 00000100:00100000:2.0:1787893341.368516:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493463296 00000100:00100000:2.0:1787893341.368546:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787893341.368553:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fd286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3631:x1874741493463296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.368588:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fd286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3631:x1874741493463296:12345-0@lo:400:kworker.0 Request processed in 35us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.368595:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787893341.368622:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493463808 00000100:00100000:2.0:1787893341.368625:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493463808 00000100:00100000:2.0:1787893341.368655:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493463680 00000100:00100000:2.0:1787893341.368658:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493463680 00000100:00100000:2.0:1787893341.368678:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787893341.368684:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493463808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.368713:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493463808:12345-0@lo:400:kworker.0 Request processed in 30us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.368719:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787893341.368730:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787893341.368743:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493463680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.368770:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493463680:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.368776:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787893341.368962:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493464320 00000100:00100000:2.0:1787893341.368966:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493464320 00000100:00100000:2.0:1787893341.368991:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493464192 00000100:00100000:2.0:1787893341.368994:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493464192 00000100:00100000:2.0:1787893341.369012:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787893341.369019:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493464320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.369051:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493464320:12345-0@lo:400:kworker.0 Request processed in 32us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.369057:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787893341.369068:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787893341.369086:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493464192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.369114:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493464192:12345-0@lo:400:kworker.0 Request processed in 29us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.369120:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787893341.369136:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493463168 00000100:00100000:2.0:1787893341.369140:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493463168 00000100:00100000:2.0:1787893341.369160:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787893341.369166:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493463168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893341.369187:0:17189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787893341.369214:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493463168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.369220:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787893341.369365:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493463040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893341.369393:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.373488:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493463552:0@lo:400:kworker.0 00000100:00100000:1.0:1787893341.373567:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.373587:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493464064:0@lo:400:kworker.0 00000100:00100000:1.0:1787893341.373613:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.373640:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787893341.373646:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493463424:0@lo:400:kworker.0 00000100:00100000:1.0:1787893341.373668:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.373688:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493463936:0@lo:400:kworker.0 00000100:00100000:1.0:1787893341.373706:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.373716:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493464448:0@lo:400:kworker.0 00000100:00100000:1.0:1787893341.373734:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.373765:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493464064 00000100:00100000:1.0:1787893341.373771:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493464064 00000100:00100000:2.0:1787893341.375464:0:19991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493463040 00000100:00100000:2.0:1787893341.375506:0:19991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493463040 00000100:00100000:2.0:1787893341.375568:0:19991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787893341.375579:0:19991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493463040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893341.375608:0:19991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893341.375678:0:19991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493463040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (6283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.375686:0:19991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787893341.375711:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493463424 00000100:00100000:2.0:1787893341.375715:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493463424 00000100:00100000:1.0:1787893341.375795:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493463936 00000100:00100000:1.0:1787893341.375805:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493463936 00000100:00080000:3.0:1787893341.377004:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893341.377011:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893341.379673:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493464448 00000100:00100000:2.0:1787893341.379684:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493464448 00000100:00100000:2.0:1787893341.379710:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787893341.379721:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493464064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.379814:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874741493464064:12345-0@lo:400:kworker.0 Request processed in 95us (6200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.379822:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787893341.379838:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787893341.379844:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493463424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.379874:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493463424:12345-0@lo:400:kworker.0 Request processed in 30us (6205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.379880:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787893341.379890:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787893341.379896:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493464448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.379920:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fe349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493464448:12345-0@lo:400:kworker.0 Request processed in 25us (6186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.379926:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787893341.379998:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493463552 00000100:00100000:2.0:1787893341.380016:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493463552 00000100:00100000:2.0:1787893341.380049:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787893341.380055:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493463552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.380100:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493463552:12345-0@lo:400:kworker.0 Request processed in 45us (6533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.380107:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787893341.380179:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493463168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893341.380194:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493463680:0@lo:400:kworker.0 00010000:00080000:2.0:1787893341.380208:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c3e6ce00 x1874741493464192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893341.380217:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493464192:0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.380227:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493463296:0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.380252:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493463808:0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.380264:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493464320:0@lo:400:kworker.0 00000100:00100000:2.0:1787893341.380318:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893341.380331:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493464576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893341.380367:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893341.380400:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493464576 00000100:00100000:2.0:1787893341.380404:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493464576 00000100:00100000:2.0:1787893341.380427:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787893341.380432:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493464576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893341.380446:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787893341.380481:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493464576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893341.380523:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787893341.380567:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493464576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893341.382678:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787893341.382691:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d29f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493463936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893341.382773:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d29f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493463936:12345-0@lo:400:kworker.0 Request processed in 85us (9065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893341.382780:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787893341.382873:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493463424:0@lo:400:kworker.0 00000100:00100000:1.0:1787893341.382890:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493463936:0@lo:400:kworker.0 00010000:00080000:1.0:1787893341.382905:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c3e6c380 x1874741493464448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893341.382914:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493464448:0@lo:400:kworker.0 00000100:00100000:1.0:1787893341.382931:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493463040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893341.382942:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493463552:0@lo:400:kworker.0 00000100:00100000:1.0:1787893341.382953:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493464064:0@lo:400:kworker.0 00000100:00080000:3.0:1787893341.383884:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893341.383891:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893341.383893:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000004:3.0:1787893341.437671:0:20772:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787893341.444726:0:20772:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787893341.444779:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.444805:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.444812:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.444820:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.444848:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787893341.444854:0:20772:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787893341.444879:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893341.444883:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787893341.444890:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787893341.444913:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7760000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787893341.445078:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893341.445086:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893341.445094:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147d600 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787893341.445099:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893341.445108:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893341.445116:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893341.445122:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787893341.445125:0:17171:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787893341.445128:0:17171:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787893341.445155:0:17171:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893341.445162:0:17171:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893341.445192:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893341.445199:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d600/0x9232577658cf1dd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1dda expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893341.445227:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893341.445229:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893341.445231:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893341.445258:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493464704:0@lo:39:umount.0 00000100:00100000:0.0:1787893341.445323:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893341.445370:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893341.445378:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493464832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893341.445404:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893341.445440:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493464704 00000100:00100000:0.0:1787893341.445447:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493464704 00000100:00100000:0.0:1787893341.445488:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787893341.445522:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874741493464704:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787893341.445560:0:17185:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1e04 00000100:00080000:0.0:1787893341.445568:0:17185:0:(import.c:65:import_set_state_nolock()) ffff9fc9f6d34000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787893341.445621:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3629:x1874741493464704:12345-0@lo:39:umount.0 Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893341.445629:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:0.0:1787893341.445640:0:17185:0:(genops.c:885:class_export_put()) final put ffff9fc9f6d36800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1787893341.445664:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493464832 00000100:00100000:0.0:1787893341.445668:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493464832 00000100:00100000:0.0:1787893341.445696:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787893341.445702:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3631:x1874741493464832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893341.445713:0:17168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893341.445728:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c84f6400/0x9232577658cf1dda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf1dd3 expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893341.445751:0:17168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893341.445776:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:3631:x1874741493464832:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893341.445796:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787893341.445815:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787893341.445823:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9f6d36800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787893341.445864:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9f6d34000 for lustre-MDT0000 00000100:00100000:0.0:1787893341.445896:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493464832:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787893341.445919:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7760000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787893341.445926:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493464704:0@lo:39:umount.0 00000100:00080000:3.0:1787893341.446652:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893341.446657:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787893341.446662:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787893341.450726:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.450761:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.450769:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.450777:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453163:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893341.453176:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453184:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453191:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453197:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453207:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787893341.453213:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453218:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453241:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453247:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453257:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787893341.453263:0:20772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453269:0:20772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453274:0:20772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453280:0:20772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893341.453287:0:20772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1787893341.453290:0:20772:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787893341.453323:0:20772:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787893341.453327:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787893341.453332:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893341.453338:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1787893341.453345:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc8c5e4f800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893341.453351:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc8c7f33800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893341.453356:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc9f6d28800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893341.453366:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc8c7d06800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893341.453373:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fc8c7616000 3f229414-7dd1-4cf5-a739-e3375b9be1a7 192.168.202.35@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1787893341.453378:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fc8c75ac000 af98d6ca-b952-492d-ad71-083813d6f146 192.168.202.35@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1787893341.453382:0:20772:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9fc8c71b8000) has exports, disconnecting them 00000020:00080000:3.0:1787893341.453386:0:20772:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc8c5e4f800), last request at 1787893341 00000020:00000080:3.0:1787893341.453393:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf2106 00000100:00080000:3.0:1787893341.453409:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5e4d800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787893341.453452:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c5e4f800): rc 0 00000020:00000080:3.0:1787893341.453454:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc8c5e4f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787893341.453463:0:20772:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc8c7f33800), last request at 1787893341 00000020:00000080:3.0:1787893341.453466:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1fa1 00000100:00080000:3.0:1787893341.453471:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7f32800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787893341.453478:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c7f33800): rc 0 00000020:00000080:3.0:1787893341.453480:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc8c7f33800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787893341.453484:0:20772:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc9f6d28800), last request at 1787893259 00000020:00000080:3.0:1787893341.453487:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1ef2 00000100:00080000:3.0:1787893341.453507:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9fc9c4b36000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787893341.453513:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9f6d28800): rc 0 00000020:00000080:3.0:1787893341.453515:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9f6d28800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787893341.453519:0:20772:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc8c7d06800), last request at 1787893259 00000020:00000080:3.0:1787893341.453523:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1e97 00000100:00080000:3.0:1787893341.453526:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7d07800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893341.453532:0:20772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:3.0:1787893341.453604:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c7d06800): rc 0 00000004:00000080:3.0:1787893341.453610:0:20772:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbaa0c7953ae0 00000100:00080000:3.0:1787893341.453626:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787893341.453636:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787893341.454594:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787893341.454620:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaf000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787893341.454769:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787893341.454773:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1787893341.454793:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787893341.454856:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787893341.454865:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9fc9d24d5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787893341.454871:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787893341.454873:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1787893341.454884:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787893341.454949:0:20772:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787893341.454956:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaa000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787893341.454996:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fc8c71b8000) has no exports 00010000:00010000:1.0:1787893341.455382:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787893341.455392:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455401:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147ce00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893341.455405:0:19536:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455415:0:19536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893341.455441:0:19536:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893341.455447:0:19536:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893341.455449:0:19536:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1787893341.455452:0:19536:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1787893341.455481:0:19536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455503:0:19536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893341.455536:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455544:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ce00/0x9232577658cf1d24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1d2b expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455558:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787893341.455562:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455568:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1400 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893341.455571:0:19536:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455578:0:19536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893341.455584:0:19536:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893341.455599:0:19536:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893341.455601:0:19536:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787893341.455603:0:19536:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787893341.455616:0:19536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455622:0:19536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893341.455637:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455644:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf213e expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455654:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893341.455658:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455664:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1600 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893341.455667:0:19536:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455674:0:19536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893341.455680:0:19536:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893341.455686:0:19536:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787893341.455689:0:19536:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787893341.455696:0:19536:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787893341.455708:0:19536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455714:0:19536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893341.455720:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455727:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf22db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf22e2 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455735:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893341.455739:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455745:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147d000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893341.455747:0:19536:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455755:0:19536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893341.455761:0:19536:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893341.455767:0:19536:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893341.455770:0:19536:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787893341.455771:0:19536:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787893341.455792:0:19536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455798:0:19536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893341.455809:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455817:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147d000/0x9232577658cf1d16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1d1d expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.455827:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893341.455829:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893341.455831:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893341.455916:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493465728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893341.455975:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.456023:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893341.456029:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c778b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493465344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893341.456051:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.456084:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493465600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893341.456105:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.456119:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893341.456124:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d15c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493465472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893341.456142:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893341.456161:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493465728 00000100:00100000:1.0:1787893341.456167:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493465728 00000100:00100000:1.0:1787893341.456202:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493465344 00000100:00100000:1.0:1787893341.456205:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493465344 00000100:00100000:1.0:1787893341.456216:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493465600 00000100:00100000:1.0:1787893341.456218:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493465600 00000100:00100000:1.0:1787893341.456227:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493465472 00000100:00100000:1.0:1787893341.456229:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493465472 00000020:00000080:0.0:1787893341.456659:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c5e4f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787893341.456698:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7f33800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787893341.456729:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9f6d28800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787893341.456751:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c5e4d800 for lustre-MDT0000 00000020:00000080:0.0:1787893341.456755:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7f32800 for lustre-MDT0000 00000020:00000080:0.0:1787893341.456759:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9c4b36000 for lustre-MDT0000 00000100:00100000:0.0:1787893341.456776:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787893341.456802:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b37fca-0eda-4b14-a6ef-4a378c945d17+26:3630:x1874741493465728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893341.456816:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893341.456833:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c84f6200/0x9232577658cf1d1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf1d16 expref: 26 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893341.456847:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893341.456889:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b37fca-0eda-4b14-a6ef-4a378c945d17+25:3630:x1874741493465728:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893341.456907:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787893341.456925:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787893341.456932:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b37fca-0eda-4b14-a6ef-4a378c945d17+24:3630:x1874741493465344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893341.456940:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893341.456949:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c84f6800/0x9232577658cf1d2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf1d24 expref: 24 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893341.456958:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893341.456977:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b37fca-0eda-4b14-a6ef-4a378c945d17+23:3630:x1874741493465344:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893341.456983:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787893341.457018:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787893341.457024:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d15ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b37fca-0eda-4b14-a6ef-4a378c945d17+22:3633:x1874741493465600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893341.457031:0:17170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893341.457039:0:17170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe540600/0x9232577658cf22e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf22db expref: 22 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893341.457047:0:17170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893341.457085:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d15ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13b37fca-0eda-4b14-a6ef-4a378c945d17+21:3633:x1874741493465600:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893341.457091:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787893341.457122:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c778b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493465344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893341.457131:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13b37fca-0eda-4b14-a6ef-4a378c945d17:3630:1874741493465728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893341.457153:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493465600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893341.457165:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893341.457354:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787893341.457364:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7d49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+20:3633:x1874741493465472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893341.457384:0:17169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893341.457394:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30400/0x9232577658cf213e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf2137 expref: 20 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893341.457406:0:17169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893341.457440:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7d49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13b37fca-0eda-4b14-a6ef-4a378c945d17+19:3633:x1874741493465472:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893341.457447:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787893341.459357:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d15c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493465472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893341.459400:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493464960:0@lo:39:umount.0 00000100:00100000:0.0:1787893341.459453:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893341.459487:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493465088:0@lo:9:umount.0 00000100:00100000:0.0:1787893341.459526:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893341.459544:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493465216:0@lo:9:umount.0 00000100:00100000:0.0:1787893341.459563:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893341.459599:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493464960 00000100:00100000:0.0:1787893341.459606:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493464960 00000100:00100000:0.0:1787893341.459644:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787893341.459652:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1874741493464960:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787893341.459677:0:17188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1f1c 00000100:00080000:0.0:1787893341.459685:0:17188:0:(import.c:65:import_set_state_nolock()) ffff9fc9d9099800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787893341.459712:0:17188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:1.0:1787893341.459824:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893341.459905:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3629:x1874741493464960:12345-0@lo:39:umount.0 Request processed in 252us (450us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787893341.459914:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787893341.459941:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493465088 00000100:00100000:0.0:1787893341.459945:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493465088 00000100:00100000:0.0:1787893341.459975:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493465216 00000100:00100000:0.0:1787893341.459978:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493465216 00000100:00100000:0.0:1787893341.460003:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787893341.460013:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1874741493465088:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787893341.460027:0:19239:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1fe7 00000100:00080000:0.0:1787893341.460033:0:19239:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7c6f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787893341.460086:0:19239:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787893341.460194:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3629:x1874741493465088:12345-0@lo:9:umount.0 Request processed in 184us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893341.460215:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787893341.460229:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787893341.460309:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1874741493465216:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787893341.460321:0:19239:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf2145 00000100:00080000:0.0:1787893341.460326:0:19239:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5e48000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787893341.460353:0:19239:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787893341.460422:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3629:x1874741493465216:12345-0@lo:9:umount.0 Request processed in 186us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893341.460430:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1787893341.460459:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893341.460465:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787893341.460513:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaf000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787893341.460522:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493464960:0@lo:39:umount.0 00000100:00080000:0.0:1787893341.460534:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d24d5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787893341.460540:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787893341.460542:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787893341.460544:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493465088:0@lo:9:umount.0 00000100:00080000:0.0:1787893341.460552:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5eaa000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787893341.460560:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787893341.460561:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787893341.460564:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493465216:0@lo:9:umount.0 00010000:00010000:0.0:1787893341.462809:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787893341.483901:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fc8c71b8000) has no exports 00000040:00080000:2.0:1787893341.492381:0:17937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1787893341.539007:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1d71 00000020:00000080:3.0:1787893341.539024:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9e5ea9000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787893341.539105:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787893341.542711:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893341.542727:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787893341.542733:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9fc9fe1419b8) has no exports 00000020:00000080:2.0:1787893341.543109:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1d6a 00000020:00000080:2.0:1787893341.543118:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9ffb47000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787893341.543191:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e5ea9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787893341.547463:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffb47000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787893341.547770:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893341.547783:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787893341.547789:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9ffb42000/lustre-QMT0000_UUID 00000020:00000080:1.0:1787893341.547792:0:20772:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffb42000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787893341.547798:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1787893341.685322:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787893342.410572:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893342.410583:0:19518:0:(genops.c:885:class_export_put()) final put ffff9fc8c5e49000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787893342.410607:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af98d6ca-b952-492d-ad71-083813d6f146 00000020:00000080:3.0:1787893342.410610:0:19518:0:(genops.c:885:class_export_put()) final put ffff9fc9fa48d000/af98d6ca-b952-492d-ad71-083813d6f146 00000001:00100000:2.0:1787893342.410713:0:17163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787893342.410718:0:17163:0:(genops.c:885:class_export_put()) final put ffff9fc8c7d06800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787893342.410726:0:17163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000001:00080000:2.0:1787893342.410735:0:17163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1787893342.410739:0:17163:0:(genops.c:885:class_export_put()) final put ffff9fc8c7616000/3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000001:00100000:2.0:1787893342.410745:0:17163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of af98d6ca-b952-492d-ad71-083813d6f146 00000001:00080000:2.0:1787893342.410750:0:17163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1787893342.410758:0:17163:0:(genops.c:885:class_export_put()) final put ffff9fc8c75ac000/af98d6ca-b952-492d-ad71-083813d6f146 00000020:00000080:0.0:1787893342.410914:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c5e49000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787893342.410978:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fa48d000/af98d6ca-b952-492d-ad71-083813d6f146 for lustre-OST0001 00000020:00000080:0.0:1787893342.411009:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7d06800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787893342.411031:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7616000/3f229414-7dd1-4cf5-a739-e3375b9be1a7 for lustre-MDT0000 00000020:00000080:0.0:1787893342.411057:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c75ac000/af98d6ca-b952-492d-ad71-083813d6f146 for lustre-MDT0000 00000020:00000080:0.0:1787893342.411093:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c5e48000 for lustre-OST0001 00000020:00000080:0.0:1787893342.411098:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9c74ee800 for lustre-OST0001 00000020:00000080:0.0:1787893342.411101:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7d07800 for lustre-MDT0000 00000020:00000080:0.0:1787893342.411103:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7610800 for lustre-MDT0000 00000020:00000080:0.0:1787893342.411106:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c75ac800 for lustre-MDT0000 00000001:00100000:0.0:1787893342.411425:0:17916:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787893342.411432:0:17916:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1787893342.411435:0:17916:0:(genops.c:885:class_export_put()) final put ffff9fc9d29e8800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787893342.411449:0:17916:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000001:00080000:0.0:1787893342.411455:0:17916:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1787893342.411456:0:17916:0:(genops.c:885:class_export_put()) final put ffff9fc8c7614800/3f229414-7dd1-4cf5-a739-e3375b9be1a7 00000001:00100000:0.0:1787893342.411461:0:17916:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of af98d6ca-b952-492d-ad71-083813d6f146 00000001:00080000:0.0:1787893342.411464:0:17916:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1787893342.411466:0:17916:0:(genops.c:885:class_export_put()) final put ffff9fc8c75ad000/af98d6ca-b952-492d-ad71-083813d6f146 00000020:00000080:2.0:1787893342.411511:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9d29e8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787893342.411570:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7614800/3f229414-7dd1-4cf5-a739-e3375b9be1a7 for lustre-MDT0001 00000020:00000080:2.0:1787893342.411590:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c75ad000/af98d6ca-b952-492d-ad71-083813d6f146 for lustre-MDT0001 00000020:00000080:2.0:1787893342.411606:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9d9099800 for lustre-MDT0001 00000020:00000080:2.0:1787893342.411609:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7615000 for lustre-MDT0001 00000020:00000080:2.0:1787893342.411612:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c75aa800 for lustre-MDT0001 00010000:00010000:0.0:1787893342.705738:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787893343.601701:0:20772:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc9d0006180 - data ffff9fc9f4035288/ffff9fc9c420c800 00000020:01000000:1.0:1787893343.601874:0:20772:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc9e5e831e0 - data ffff9fc9f426bbd0/ffff9fc9d04e5400 00000001:00000004:1.0:1787893343.606865:0:20772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1787893343.662452:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787893343.662461:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787893343.662476:0:20772:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9fc9e711ca80 x1874741493464960/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787893351 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893343.662588:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787893343.665538:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787893343.665546:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1787893343.665563:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893343.665565:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787893343.665925:0:17207:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787893343.665929:0:17207:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1787893343.665937:0:17207:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787893343.666602:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787893343.666606:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1787893343.666622:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893343.666624:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787893343.666933:0:17209:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787893343.666937:0:17209:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1787893343.666945:0:17209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787893343.669165:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1d39 00000020:00000080:2.0:1787893343.669176:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9f6d2e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787893343.671025:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1d4e 00000020:00000080:2.0:1787893343.671037:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9f6d36000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787893343.674397:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9f6d2e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787893343.678907:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787893343.678923:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893343.678999:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787893343.679005:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9fc8c71bb370) has no exports 00000004:01000000:2.0:1787893343.679198:0:20772:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787893343.679273:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1db0 00000020:00000080:2.0:1787893343.679282:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9ffb13000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787893343.679288:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787893343.679292:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893343.679296:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787893343.679298:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9fc9fe140000) has no exports 00000020:00000080:2.0:1787893343.679305:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1da9 00000020:00000080:2.0:1787893343.679309:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9e5ea8800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787893343.679378:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9f6d36000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787893343.679392:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffb13000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787893343.679402:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e5ea8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787893343.680759:0:20772:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787893343.680766:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787893343.680770:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1787893343.680778:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893343.680780:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787893343.680879:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893343.680888:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893343.680897:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1d9b 00000020:00000080:2.0:1787893343.680917:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc8c8412000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787893343.684783:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9e5eaa000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787893343.684804:0:8:0:(genops.c:885:class_export_put()) final put ffff9fc8c855a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787893343.684808:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c855a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787893343.684831:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787893343.685838:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787893343.685850:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893343.685860:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787893343.685865:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9fc8c77319b8) has no exports 00000020:00000080:2.0:1787893343.685874:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1d94 00000020:00000080:2.0:1787893343.685881:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9d24d4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787893343.686032:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c8412000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787893343.686041:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9d24d4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787893343.688139:0:20772:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787893343.688146:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787893343.688151:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1787893343.688158:0:20772:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893343.688160:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787893343.688367:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893343.688378:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787893343.688394:0:20772:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787893343.688402:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1d86 00000020:00000080:2.0:1787893343.688410:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9e5eab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787893343.693477:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9d24d5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787893343.693515:0:8:0:(genops.c:885:class_export_put()) final put ffff9fc9e5eaf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787893343.693526:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e5eaf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787893343.693537:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787893343.703660:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787893343.703688:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893343.703700:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787893343.703706:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9fc9e73599b8) has no exports 00000020:00000080:2.0:1787893343.703714:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1d7f 00000020:00000080:2.0:1787893343.703724:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9e5ead000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787893343.703975:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e5eab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787893343.703988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e5ead000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787893343.706539:0:20772:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787893343.706548:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787893343.706552:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787893343.706559:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787893343.706607:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893343.706618:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893343.706644:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893343.706646:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893343.706652:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9f6d2c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787893343.706665:0:20772:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9f6d2c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787893343.706678:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893343.706773:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1d55 00000020:00000080:2.0:1787893343.706779:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9f6d33800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787893343.706784:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787893343.706787:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893343.706792:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787893343.706795:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9fc8c71bcd28) has no exports 00000020:00000080:2.0:1787893343.706814:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893343.706817:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787893343.706820:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1d5c 00000020:00000080:2.0:1787893343.706823:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9f6d33000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787893343.706829:0:20772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9d0f72800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787893343.706832:0:20772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9d0f72800 3 00000020:01000004:2.0:1787893343.706835:0:20772:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc9d0f72800 from lustre-MDT0000 00000020:00000080:2.0:1787893343.706852:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893343.706855:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787893343.706857:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9f6d2f000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787893343.706859:0:20772:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9f6d2f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787893343.706866:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787893343.706894:0:20772:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787893343.706896:0:20772:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787893343.706899:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787893343.706901:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893343.706904:0:20772:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787893343.706910:0:20772:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9fc9e70b8800 13b37fca-0eda-4b14-a6ef-4a378c945d17 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787893343.706916:0:20772:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9fc9fe144d28) has exports, disconnecting them 00000020:00080000:2.0:1787893343.706920:0:20772:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fc9e70b8800), last request at 1787893244 00000020:00000080:2.0:1787893343.706932:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1d01 00000020:00010000:2.0:1787893343.706935:0:20772:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc9e70b8800: total 2 00000100:00080000:2.0:1787893343.706939:0:20772:0:(import.c:65:import_set_state_nolock()) ffff9fc9e70ba800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787893343.706948:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9e70b8800): rc 0 00000020:00080000:2.0:1787893343.706956:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9fc9fe144d28) has no exports 00000100:00100000:2.0:1787893343.707010:0:17175:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fc9fe09ee00:17175] 0 exiting: rc = 1 00000100:00100000:2.0:1787893343.707110:0:17178:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fc9fe13d400:17178] 2 exiting: rc = 0 00000020:00010000:0.0:1787893343.707252:0:19536:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc9e70b8800: total 2 00010000:00010000:0.0:1787893343.707256:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893343.707300:0:19536:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc9e70b8800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787893343.707327:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf1e2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf1e27 expref: 14 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707345:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147c000/0x9232577658cf1e20 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf1e19 expref: 13 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707358:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c84f7400/0x9232577658cf20c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf20c0 expref: 12 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707369:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31400/0x9232577658cf22c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf22bf expref: 11 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707378:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147d200/0x9232577658cf1e3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf1e35 expref: 10 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707388:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c84f7000/0x9232577658cf1d0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf1d08 expref: 9 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707408:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c84f7c00/0x9232577658cf1f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf1f85 expref: 8 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707418:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf22b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf22b1 expref: 7 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707428:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541200/0x9232577658cf1edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf1ed6 expref: 6 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707438:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c67e1200/0x9232577658cf22d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf22cd expref: 5 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707450:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9c147dc00/0x9232577658cf20f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf20ea expref: 4 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707459:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30c00/0x9232577658cf2130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf2129 expref: 3 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707469:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c84f6c00/0x9232577658cf1f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9232577658cf1f5b expref: 2 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893343.707479:0:19536:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc9e70b8800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787893343.707514:0:19536:0:(genops.c:885:class_export_put()) final put ffff9fc9e70b8800/13b37fca-0eda-4b14-a6ef-4a378c945d17 00010000:00010000:0.0:1787893343.707519:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893343.707521:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893343.707523:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893343.707542:0:17177:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fc9fe13c000:17177] 1 exiting: rc = 0 00000020:00000080:0.0:1787893343.707585:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9e5eaf000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787893343.707590:0:8:0:(genops.c:885:class_export_put()) final put ffff9fc9e5eaa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787893343.707597:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e5eaa800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787893343.707601:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787893343.707635:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9f6d33800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787893343.707638:0:8:0:(genops.c:885:class_export_put()) final put ffff9fc9f6d32800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787893343.707640:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9f6d32800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787893343.707643:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787893343.707664:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9f6d33000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787893343.707667:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e70b8800/13b37fca-0eda-4b14-a6ef-4a378c945d17 for MGS 00000020:00000080:0.0:1787893343.707695:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9e70ba800 for MGS 00000100:00100000:2.0:1787893343.707762:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707769:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707776:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707781:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707787:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707793:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707798:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707804:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707809:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707815:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707821:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707827:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707832:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707837:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707842:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707848:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707853:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707858:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707863:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707868:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707872:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707877:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707882:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707887:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707892:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707897:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707903:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707908:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707913:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707918:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707923:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707935:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707941:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707947:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707952:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707957:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707965:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707970:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707975:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707980:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707985:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707991:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.707996:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708001:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708006:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708011:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708016:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708022:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708027:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708032:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708037:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708042:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708060:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708067:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708072:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708077:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708082:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708087:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708093:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708098:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708103:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708108:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708114:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893343.708119:0:20772:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787893343.709064:0:20772:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc8c71ee900 - data ffff9fc9f40f4bd0/ffff9fc9fa1d6800 00000020:01000000:2.0:1787893343.709182:0:20772:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc8c77cb1e0 - data ffff9fc9f421aca8/ffff9fc8c7cadc00 00000020:00000080:2.0:1787893343.710269:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1ce5 00000020:00000080:2.0:1787893343.710384:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc8c84c2000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787893343.710442:0:20772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9d0f72800 from MGS, refs=2 00000020:01000004:2.0:1787893343.710447:0:20772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9d0f72800 2 00000020:01000004:2.0:1787893343.710449:0:20772:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc9d0f72800 from MGS 00000020:00000080:2.0:1787893343.710470:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893343.710477:0:20772:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787893343.710479:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc8c84c5800/MGS 00000020:00000080:2.0:1787893343.710482:0:20772:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c84c5800/MGS for MGS 00000020:01000000:2.0:1787893343.710488:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787893343.710564:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787893343.710568:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893343.710572:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787893343.710578:0:20772:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fc8c7765800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787893343.710583:0:20772:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9fc8c7733370) has exports, disconnecting them 00000020:00080000:2.0:1787893343.710588:0:20772:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fc8c7765800), last request at 1787893244 00000020:00000080:2.0:1787893343.710592:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1de8 00000020:00080000:2.0:1787893343.710601:0:20772:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c7765800): rc 0 00000020:00000080:2.0:1787893343.710604:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc8c7765800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787893343.712393:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c84c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787893343.716130:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7765800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787893343.724728:0:20772:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787893343.724737:0:20772:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787893343.724741:0:20772:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787893343.724749:0:20772:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787893343.724782:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7760000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787893343.724960:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893343.724968:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787893343.724973:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9fd123800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787893343.724977:0:20772:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd123800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787893343.724988:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787893343.725107:0:20772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9d0f72800 1 00000020:00000080:0.0:1787893343.725114:0:20772:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1cd7 00000020:00000080:0.0:1787893343.725120:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc8c84c5000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787893343.725129:0:20772:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787893343.725138:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c84c5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787893343.725147:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893343.725151:0:20772:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787893343.725155:0:20772:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9fc9e7358000) has no exports 00010000:00010000:0.0:1787893343.780955:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787893343.855347:0:20772:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893343.855359:0:20772:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787893343.855365:0:20772:0:(genops.c:885:class_export_put()) final put ffff9fc9d0f73000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787893343.855369:0:20772:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9d0f73000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787893343.855375:0:20772:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787893343.855488:0:20772:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc9d0f76000 00000020:02000400:0.0:1787893343.857112:0:20772:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787893344.822482:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893345.846630:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893346.482229:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493466112:0@lo:400:kworker.0 00000100:00100000:1.0:1787893346.482332:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893346.482411:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493466624:0@lo:400:kworker.0 00000100:00100000:1.0:1787893346.482442:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893346.482484:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787893346.482512:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493465984:0@lo:400:kworker.0 00000400:00000100:1.0:1787893346.482537:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874741493465984 offset 0 length 224: 4 00000100:00100000:1.0:1787893346.482556:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493466496:0@lo:400:kworker.0 00000100:00100000:1.0:1787893346.482590:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893346.482609:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493467008:0@lo:400:kworker.0 00000100:00100000:1.0:1787893346.482631:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893346.482669:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493466112 00000100:00100000:1.0:1787893346.482678:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493466112 00000100:00100000:0.0:1787893346.484188:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493465856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893346.484260:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893346.484300:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493466368:0@lo:400:kworker.0 00000100:00100000:0.0:1787893346.484327:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893346.484348:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493466880:0@lo:400:kworker.0 00000100:00100000:0.0:1787893346.484374:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893346.484401:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787893346.484408:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493466240:0@lo:400:kworker.0 00000100:00100000:0.0:1787893346.484430:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893346.484447:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493466752:0@lo:400:kworker.0 00000100:00100000:0.0:1787893346.484470:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893346.484538:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493465856 00000100:00100000:0.0:1787893346.484546:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493465856 00000100:00100000:0.0:1787893346.484619:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787893346.484631:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493465856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893346.484671:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787893346.484722:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493465856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893346.484749:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787893346.484777:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493466368 00000100:00100000:0.0:1787893346.484781:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493466368 00000100:00100000:0.0:1787893346.484807:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493466240 00000100:00100000:0.0:1787893346.484809:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493466240 00000100:00100000:0.0:1787893346.484823:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787893346.484830:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493466368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893346.484864:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493466368:12345-0@lo:400:kworker.0 Request processed in 35us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893346.484871:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787893346.484880:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787893346.484886:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493466240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893346.484911:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493466240:12345-0@lo:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893346.484917:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787893346.484937:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493466624 00000100:00100000:0.0:1787893346.484940:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493466624 00000100:00100000:0.0:1787893346.484958:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493466496 00000100:00100000:0.0:1787893346.484961:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493466496 00000100:00100000:0.0:1787893346.484969:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493467008 00000100:00100000:0.0:1787893346.484972:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493467008 00000100:00100000:0.0:1787893346.484988:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493466880 00000100:00100000:0.0:1787893346.484991:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493466880 00000100:00100000:0.0:1787893346.485001:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493466752 00000100:00100000:0.0:1787893346.485004:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493466752 00000100:00100000:0.0:1787893346.485018:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787893346.485036:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493467008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893346.485074:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493467008:12345-0@lo:400:kworker.0 Request processed in 50us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893346.485088:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787893346.485101:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787893346.485107:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493466752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893346.485137:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493466752:12345-0@lo:400:kworker.0 Request processed in 30us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893346.485143:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787893346.485155:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787893346.485159:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874741493466624:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787893346.485165:0:17185:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787893346.485191:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874741493466624:12345-0@lo:400:kworker.0 Request processed in 30us (2749us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787893346.485196:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787893346.485208:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787893346.485212:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874741493466496:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787893346.485216:0:17185:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787893346.485242:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874741493466496:12345-0@lo:400:kworker.0 Request processed in 30us (2652us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787893346.485247:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787893346.485257:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787893346.485261:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3631:x1874741493466880:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787893346.485265:0:17185:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787893346.485283:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3631:x1874741493466880:12345-0@lo:400:kworker.0 Request processed in 21us (909us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787893346.485288:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787893346.485347:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493466240:0@lo:400:kworker.0 00010000:00080000:0.0:1787893346.485372:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9fc9fa529c00 x1874741493466752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893346.485384:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493466752:0@lo:400:kworker.0 00000100:00100000:0.0:1787893346.485402:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493465856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787893346.485413:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493466368:0@lo:400:kworker.0 00000100:00080000:0.0:1787893346.485423:0:3631:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787893346.485429:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffc1b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787893346.485432:0:3631:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787893346.486022:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893346.486050:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493467136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893346.486099:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893346.486265:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493467136 00000100:00100000:1.0:1787893346.486283:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493467136 00000100:00100000:1.0:1787893346.486366:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787893346.486380:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493467136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893346.486420:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787893346.486539:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493467136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893346.486547:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787893346.486711:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893346.486719:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893346.486722:0:17179:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893346.488126:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493467136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893346.488601:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787893346.488613:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1874741493466112:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787893346.488623:0:17188:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787893346.488854:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1874741493466112:12345-0@lo:400:kworker.0 Request processed in 239us (6520us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787893346.488862:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787893346.488928:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787893346.488933:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75f9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787893346.488937:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787893346.488941:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75f9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893346.488945:0:3633:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:1.0:1787893346.488952:0:3633:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fc8c75f9000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893346.488988:0:3633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fa528000 x1874741493467392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893346.489054:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493466496:0@lo:400:kworker.0 00010000:00080000:1.0:1787893346.489076:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9fc9fa528e00 x1874741493467008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893346.489086:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493467008:0@lo:400:kworker.0 00000100:00080000:1.0:1787893346.489097:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787893346.489099:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7741000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787893346.489102:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787893346.489106:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7741000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893346.489109:0:3633:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:1.0:1787893346.489113:0:3633:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc8c7741000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893346.489129:0:3633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fa52b480 x1874741493467520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893346.489138:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493466112:0@lo:400:kworker.0 00000100:00080000:1.0:1787893346.489151:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787893346.489154:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7c6a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787893346.489157:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787893346.489160:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7c6a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893346.489162:0:3633:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 518 00000100:00080000:1.0:1787893346.489167:0:3633:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc8c7c6a000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893346.489180:0:3633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fa528a80 x1874741493467648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893346.489203:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3633:1874741493466624:0@lo:400:kworker.0 00000100:00080000:1.0:1787893346.489279:0:3630:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9fc9c3e6ce00 x1874741493467264/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893346.489309:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493467392:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787893346.491803:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893346.491851:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493467520:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787893346.491883:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893346.491900:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493467648:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787893346.491919:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893346.492010:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493467392 00000100:00100000:1.0:1787893346.492017:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493467392 00000100:00100000:1.0:1787893346.492059:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493467648 00000100:00100000:1.0:1787893346.492062:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493467648 00000100:00100000:1.0:1787893346.492076:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787893346.492083:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493467392:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1787893346.492103:0:17185:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787893346.497852:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493467520 00000100:00100000:3.0:1787893346.497875:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493467520 00000100:00100000:3.0:1787893346.497983:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787893346.498003:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493467520:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1787893346.498041:0:17189:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787893346.498155:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493467520:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 153us (6271us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787893346.498164:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787893346.498227:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7741000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893346.498234:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787893346.498238:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493467520:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787893346.498280:0:19990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787893346.498288:0:19990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1874741493467648:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1787893346.498299:0:19990:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787893346.498336:0:19990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3629:x1874741493467648:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 47us (6414us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787893346.498343:0:19990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787893346.498375:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7c6a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893346.498380:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787893346.498383:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493467648:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1787893346.504699:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffc1b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893346.504712:0:3631:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 533 00000100:00080000:0.0:1787893346.504724:0:3631:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc9ffc1b800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893346.504785:0:3631:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8481c00 x1874741493467776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893346.504831:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493466880:0@lo:400:kworker.0 00000100:00100000:3.0:1787893346.505415:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493467776:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787893346.506627:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893346.507563:0:20187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493467776 00000100:00100000:2.0:1787893346.507576:0:20187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493467776 00000100:00100000:2.0:1787893346.507634:0:20187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787893346.507643:0:20187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3629:x1874741493467776:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1787893346.507674:0:20187:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787893346.507753:0:20187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3629:x1874741493467776:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 108us (1129us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787893346.507770:0:20187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787893346.507826:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffc1b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893346.507831:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787893346.507835:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493467776:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787893346.557740:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493467392:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 65647us (65934us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787893346.557756:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787893346.557813:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75f9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893346.557818:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787893346.557822:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493467392:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1787893346.865805:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787893347.002587:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893347.002601:0:18699:0:(genops.c:885:class_export_put()) final put ffff9fc8c7c69800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893347.002636:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7c69800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787893347.002698:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7c6f000 for lustre-OST0000 00000020:01000004:2.0:1787893347.642209:0:20973:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787893347.653482:0:20973:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787893347.653592:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.653611:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.653619:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.653628:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.653665:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787893347.653672:0:20973:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787893347.653698:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893347.653703:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787893347.653710:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787893347.653716:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75f9000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787893347.653721:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893347.653723:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787893347.653726:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787893347.654564:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654576:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654583:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654608:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654629:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787893347.654634:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654640:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654645:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654651:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654662:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787893347.654668:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654674:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654679:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654685:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654700:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1787893347.654705:0:20973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654711:0:20973:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654716:0:20973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654721:0:20973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893347.654728:0:20973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1787893347.654731:0:20973:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1787893347.654752:0:20973:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787893347.654756:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787893347.654759:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893347.654765:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787893347.654773:0:20973:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fc8c5e48800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893347.654779:0:20973:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fc8c7f36000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893347.654784:0:20973:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9fc9fd338000) has exports, disconnecting them 00000020:00080000:3.0:1787893347.654788:0:20973:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fc8c5e48800), last request at 1787893346 00000020:00000080:3.0:1787893347.654796:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf211b 00000100:00080000:3.0:1787893347.654813:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7419800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787893347.654861:0:20973:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c5e48800): rc 0 00000020:00000080:3.0:1787893347.654864:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc8c5e48800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787893347.654875:0:20973:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fc8c7f36000), last request at 1787893346 00000020:00000080:3.0:1787893347.654884:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1fb6 00000100:00080000:3.0:1787893347.654891:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7f30000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787893347.654903:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c5e48800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787893347.654953:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7419800 for lustre-MDT0001 00000020:00080000:3.0:1787893347.654965:0:20973:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c7f36000): rc 0 00000020:00000080:3.0:1787893347.654967:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc8c7f36000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787893347.654977:0:20973:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbaa0c0d9bae0 00000020:00000080:3.0:1787893347.654989:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7f36000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787893347.655038:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7f30000 for lustre-MDT0001 00000100:00080000:3.0:1787893347.655058:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893347.655067:0:20973:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9fc9c3e6ce00 x1874741493467264/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893347.655082:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787893347.655953:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787893347.655959:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7741000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1787893347.656081:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787893347.656089:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656099:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6e00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893347.656104:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656114:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893347.656121:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893347.656127:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893347.656129:0:17171:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787893347.656132:0:17171:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787893347.656179:0:17171:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656185:0:17171:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893347.656211:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656219:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6e00/0x9232577658cf1ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1edd expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656242:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787893347.656245:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656250:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7a00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893347.656253:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656260:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893347.656266:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893347.656272:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893347.656274:0:17171:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1787893347.656276:0:17171:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1787893347.656290:0:17171:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656296:0:17171:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893347.656314:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656321:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7a00/0x9232577658cf1e35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1e3c expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656329:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787893347.656333:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656344:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540400 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893347.656347:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656354:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893347.656360:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893347.656365:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893347.656367:0:17171:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787893347.656369:0:17171:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787893347.656383:0:17171:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656389:0:17171:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893347.656395:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656401:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf2129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf2130 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656414:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787893347.656417:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656423:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893347.656426:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656438:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893347.656445:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893347.656450:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787893347.656453:0:17171:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787893347.656455:0:17171:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787893347.656465:0:17171:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656470:0:17171:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893347.656475:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656481:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31200/0x9232577658cf22cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf22d4 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656510:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893347.656514:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656520:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6600 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893347.656523:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656530:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893347.656545:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893347.656551:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893347.656553:0:17171:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787893347.656554:0:17171:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787893347.656564:0:17171:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656569:0:17171:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893347.656573:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656581:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f6600/0x9232577658cf1e27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9232577658cf1e2e expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893347.656592:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893347.656594:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893347.656596:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893347.656615:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493468032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893347.656704:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893347.656760:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893347.656766:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493468160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893347.656784:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893347.656818:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493468032 00000100:00100000:2.0:1787893347.656826:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493468032 00000100:00100000:2.0:1787893347.656856:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493468160 00000100:00100000:2.0:1787893347.656858:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493468160 00000100:00100000:2.0:1787893347.656870:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787893347.656882:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3632:x1874741493468032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787893347.656889:0:17170:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787893347 with bad export cookie 10534578644180737281 00000100:00100000:3.0:1787893347.658636:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493467904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893347.658700:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893347.658723:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493468416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893347.658738:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893347.658752:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893347.658757:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493468288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893347.658775:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893347.660063:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1874741493467264:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787893347.660432:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893347.660441:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893347.660459:0:17168:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787893347.660482:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787893347.661695:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493467904 00000100:00100000:0.0:1787893347.661707:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493467904 00000100:00100000:0.0:1787893347.661744:0:17168:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787893347.661751:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493468416 00000100:00100000:0.0:1787893347.661753:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493468416 00000100:00100000:0.0:1787893347.661776:0:17168:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787893347.661781:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493468288 00000100:00100000:0.0:1787893347.661784:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493468288 00000100:00100000:0.0:1787893347.661875:0:20974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787893347.661885:0:20974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3632:x1874741493468160:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787893347.661893:0:20974:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787893347 with bad export cookie 10534578644180737281 00000100:00100000:0.0:1787893347.662006:0:20974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3632:x1874741493468160:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (5219us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787893347.662024:0:20974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787893347.662042:0:20974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787893347.662046:0:20974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3631:x1874741493467904:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787893347.662051:0:20974:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787893347 with bad export cookie 10534578644180737281 00000100:00100000:0.0:1787893347.662085:0:20974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3631:x1874741493467904:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (3384us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787893347.662091:0:20974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787893347.662125:0:3631:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.135@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787893347.662131:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9fc8c8416000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787893347.662135:0:3631:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787893347.667239:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787893347.667249:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1787893347.667266:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787893347.667324:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787893347.667357:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9fc9c3ea8000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787893347.667398:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787893347.667401:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1787893347.667415:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787893347.667476:0:20973:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787893347.667486:0:20973:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29e9000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787893347.667682:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9fc9fd338000) has no exports 00000100:00100000:3.0:1787893347.671330:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787893347.671346:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3631:x1874741493468416:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787893347.671354:0:17169:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787893347 with bad export cookie 10534578644180737281 00000100:00100000:3.0:1787893347.671450:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3631:x1874741493468416:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (12708us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787893347.671460:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787893347.671516:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787893347.671521:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3631:x1874741493468288:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787893347.671526:0:17169:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787893347 with bad export cookie 10534578644180737281 00000100:00100000:3.0:1787893347.671554:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3631:x1874741493468288:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (12778us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787893347.671560:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787893347.671602:0:3632:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.135@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1787893347.672108:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493468544:0@lo:9:umount.0 00000100:00100000:1.0:1787893347.672153:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893347.672187:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493468672:0@lo:9:umount.0 00000100:00100000:1.0:1787893347.672210:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893347.672312:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493468544 00000100:00100000:1.0:1787893347.672319:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493468544 00000100:00100000:1.0:1787893347.672358:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493468672 00000100:00100000:1.0:1787893347.672361:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493468672 00000100:00100000:1.0:1787893347.672381:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787893347.672387:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1874741493468544:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787893347.672411:0:19239:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1fe0 00000100:00080000:1.0:1787893347.672421:0:19239:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7f34000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787893347.672462:0:19239:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1787893347.672618:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3629:x1874741493468544:12345-0@lo:9:umount.0 Request processed in 230us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893347.672626:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787893347.672640:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787893347.672646:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1874741493468672:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787893347.672659:0:19239:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf214c 00000100:00080000:1.0:1787893347.672665:0:19239:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5e4a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787893347.672694:0:19239:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787893347.672768:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3629:x1874741493468672:12345-0@lo:9:umount.0 Request processed in 122us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893347.672775:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787893347.672817:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c3ea8000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787893347.672824:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787893347.672827:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787893347.672843:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493468544:0@lo:9:umount.0 00000100:00080000:1.0:1787893347.672856:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9d29e9000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787893347.672860:0:3629:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787893347.672862:0:3629:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787893347.672864:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493468672:0@lo:9:umount.0 00000100:00080000:0.0:1787893347.677337:0:3631:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.135@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787893347.677343:0:3631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787893347.677353:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c7d4bb80 x1874741493465984/t0(0) o400->MGC192.168.202.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787893362 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893347.677383:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9c3e6ca80 x1874741493468032/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787893363 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893347.677395:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9c3e6f100 x1874741493468160/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787893363 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893347.677404:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9c3e6f800 x1874741493467904/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787893363 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893347.677432:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9c3e6e300 x1874741493468416/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787893363 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893347.677441:0:3631:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9c3e6c700 x1874741493468288/t0(0) o103->MGC192.168.202.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787893363 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787893347.677463:0:3631:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787893347.677466:0:3631:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787893347.677468:0:3631:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787893347.677899:0:3632:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9fc8c8416000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787893347.677926:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493468032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893347.677953:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13b37fca-0eda-4b14-a6ef-4a378c945d17:3632:1874741493468160:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787893347.682210:0:3631:0:(import.c:65:import_set_state_nolock()) ffff9fc8c8416000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893347.682224:0:3631:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 488 00000100:00080000:0.0:1787893347.682235:0:3631:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import ffff9fc8c8416000 using connection 192.168.202.135@tcp/0@lo 00010000:00010000:0.0:1787893347.682253:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893347.682307:0:3631:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8480000 x1874741493468800/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893347.682351:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13b37fca-0eda-4b14-a6ef-4a378c945d17:3629:1874741493468800:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1787893347.682405:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874741493468800 offset 0 length 520: 4 00000100:00100000:0.0:1787893347.682517:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493468416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893347.682540:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493468288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893347.682544:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13b37fca-0eda-4b14-a6ef-4a378c945d17:3631:1874741493467904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893347.683990:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13b37fca-0eda-4b14-a6ef-4a378c945d17:3633:1874741493465984:0@lo:400:kworker.0 00010000:00010000:2.0:1787893347.684294:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1787893347.684423:0:17170:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874741493468032 offset 224 length 224: 4 00000100:00100000:2.0:1787893347.684443:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3632:x1874741493468032:12345-0@lo:103:ldlm_bl.0 Request processed in 27560us (27739us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787893347.684454:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00080000:2.0:1787893347.690797:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9fc9fd338000) has no exports 00000020:01000000:0.0:1787893347.757867:0:20973:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc9d0006f60 - data ffff9fc9f4280948/ffff9fc9c41f5800 00000020:01000000:0.0:1787893347.758041:0:20973:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc9d0006000 - data ffff9fc9f408a870/ffff9fc9c4154000 00000001:00000004:0.0:1787893347.767737:0:20973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1787893347.826450:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893347.826458:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787893347.826465:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787893347.831793:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787893347.831818:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1787893347.831837:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787893347.831839:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787893347.832177:0:17924:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787893347.832182:0:17924:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787893347.832192:0:17924:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1787893347.832729:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787893347.832732:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1787893347.832748:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787893347.832749:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787893347.832972:0:17926:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787893347.832976:0:17926:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1787893347.832985:0:17926:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1787893347.833987:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1e4a 00000020:00000080:3.0:1787893347.833998:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc8c7763000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787893347.834594:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7763000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787893347.834799:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1e5f 00000020:00000080:3.0:1787893347.834804:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9c5fdc000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787893347.834845:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787893347.834851:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893347.834859:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787893347.834863:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9fc9fd33b370) has no exports 00000004:01000000:3.0:1787893347.835028:0:20973:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787893347.835035:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1eb3 00000020:00000080:3.0:1787893347.835038:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9c3eae000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787893347.838137:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c5fdc000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787893347.842730:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787893347.842746:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893347.842759:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787893347.842764:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9fc8c71b99b8) has no exports 00000020:00000080:3.0:1787893347.842774:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1eac 00000020:00000080:3.0:1787893347.842783:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9f6d32000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787893347.842812:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c3eae000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1787893347.847099:0:20973:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787893347.847108:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787893347.847112:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1787893347.847120:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787893347.847122:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787893347.852514:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9f6d32000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787893347.854117:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893347.854133:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787893347.854143:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1e9e 00000020:00000080:3.0:1787893347.854168:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc8c75fc000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787893347.861276:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787893347.861314:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893347.861326:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787893347.861332:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9fc9fd33cd28) has no exports 00000020:00000080:3.0:1787893347.861342:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1e90 00000020:00000080:3.0:1787893347.861351:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9c3eaf000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787893347.861779:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9d29e9000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787893347.861792:0:37:0:(genops.c:885:class_export_put()) final put ffff9fc8c75fe000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787893347.861794:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c75fe000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1787893347.861808:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787893347.861901:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c75fc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787893347.861906:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c3eaf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787893347.862836:0:20973:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787893347.862842:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787893347.862847:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1787893347.862854:0:20973:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787893347.862857:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787893347.862943:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893347.862952:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787893347.862965:0:20973:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787893347.862971:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1e82 00000020:00000080:3.0:1787893347.862979:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9c3eac800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787893347.866197:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9c3ea8000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787893347.866215:0:37:0:(genops.c:885:class_export_put()) final put ffff9fc9c3eac000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787893347.866218:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c3eac000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1787893347.866225:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787893347.866398:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787893347.866406:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893347.866416:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787893347.866421:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9fc9fe143370) has no exports 00000020:00000080:3.0:1787893347.866430:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1e7b 00000020:00000080:3.0:1787893347.866437:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9c5fdb800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787893347.867995:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c3eac800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787893347.868007:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c5fdb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787893347.871376:0:20973:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787893347.871390:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787893347.871395:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787893347.871403:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787893347.871437:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7741000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787893347.871532:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893347.871543:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787893347.871549:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9c4b37000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787893347.871553:0:20973:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c4b37000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787893347.871559:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787893347.871729:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893347.871734:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787893347.871737:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc8c7745800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787893347.871739:0:20973:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7745800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787893347.871744:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787893347.871835:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1e66 00000020:00000080:2.0:1787893347.871843:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9c5fdf800/lustre-MDD0001_UUID 00000020:01000000:2.0:1787893347.871852:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787893347.871860:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c5fdf800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1787893347.871870:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893347.871874:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787893347.871878:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9fc9fd3399b8) has no exports 00000020:00000080:2.0:1787893347.871905:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893347.871909:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1787893347.871911:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9c5fdb000/lustre-MDD0001_UUID 00000020:00000080:2.0:1787893347.871913:0:20973:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c5fdb000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1787893347.871917:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1787893347.872034:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1e6d 00000020:00000080:2.0:1787893347.872040:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9c5fd8800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787893347.872053:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c5fd8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:2.0:1787893347.872064:0:20973:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9ffb45000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1787893347.872067:0:20973:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9ffb45000 2 00000020:01000004:2.0:1787893347.872071:0:20973:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc9ffb45000 from lustre-MDT0001 00000020:00000080:2.0:1787893347.872090:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893347.872094:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1787893347.872097:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc8c7760800/lustre-MDT0001_UUID 00000020:00000080:2.0:1787893347.872105:0:20973:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7760800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1787893347.872112:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1787893347.872145:0:20973:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1787893347.872149:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1787893347.872152:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893347.872156:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787893347.872163:0:20973:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9fc9fd120800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787893347.872168:0:20973:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9fc9ed578000) has exports, disconnecting them 00000020:00080000:2.0:1787893347.872173:0:20973:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9fc9fd120800), last request at 1787893259 00000020:00000080:2.0:1787893347.872177:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1eeb 00000020:00080000:2.0:1787893347.872188:0:20973:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9fd120800): rc 0 00000020:00000080:2.0:1787893347.872191:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9fd120800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787893347.872219:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fd120800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:00010000:1.0:1787893347.924093:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:3.0:1787893347.924594:0:20973:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787893347.924599:0:20973:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893347.924605:0:20973:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787893347.924614:0:20973:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787893347.924749:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c75f9000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787893347.924935:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893347.924946:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1787893347.924952:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9f6d2e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787893347.924956:0:20973:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9f6d2e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787893347.924969:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787893347.925067:0:20973:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9ffb45000 1 00000020:00000080:1.0:1787893347.925075:0:20973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1e12 00000020:00000080:1.0:1787893347.925084:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9ffb15000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787893347.925093:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787893347.925098:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893347.925102:0:20973:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787893347.925106:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9fc9e735b370) has no exports 00000020:00000080:3.0:1787893347.925138:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9ffb15000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787893347.962606:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893347.962621:0:20973:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1787893347.962638:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc9e5e4e800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787893347.962643:0:20973:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9e5e4e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787893347.962659:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1787893347.962792:0:20973:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc9ffb47800 00000020:01000000:1.0:1787893347.962813:0:20973:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787893347.962816:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893347.962821:0:20973:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787893347.962824:0:20973:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9fc8c7734d28) has no exports 00000100:00100000:2.0:1787893347.963304:0:17183:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9fc9ca869400:17183] 0 exiting: rc = 1 00000100:00100000:2.0:1787893347.963632:0:20187:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9fc8c5e3a600:20187] 4 exiting: rc = 0 00000100:00100000:2.0:1787893347.963701:0:19990:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9fc8c7fcd200:19990] 3 exiting: rc = 0 00000100:00100000:3.0:1787893347.963808:0:17184:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9fc8c7411200:17184] 1 exiting: rc = 0 00000100:00100000:1.0:1787893347.964070:0:17185:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9fc9edae8e00:17185] 2 exiting: rc = 0 00000100:00100000:1.0:1787893347.964298:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964307:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964313:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964319:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964324:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964329:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964334:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964339:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964344:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964350:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964356:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964362:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964368:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964374:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964380:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964386:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964392:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964398:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964406:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964411:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964417:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964423:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964429:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964434:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964440:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964464:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964647:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964653:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964659:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964665:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964671:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964676:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964683:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964688:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964695:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964701:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964707:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964712:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964718:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964985:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964993:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.964998:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965004:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965020:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965027:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965034:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965040:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965045:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965051:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965058:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965064:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965070:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965076:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965082:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965087:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965093:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965099:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965105:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965110:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965116:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965130:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965136:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965143:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.965148:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893347.968683:0:17186:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fc8c7411400:17186] 0 exiting: rc = 1 00000100:00100000:2.0:1787893347.968901:0:17187:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fc9edae8600:17187] 1 exiting: rc = 0 00000100:00100000:1.0:1787893347.970828:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970840:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970847:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970852:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970857:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970863:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970868:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970873:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970878:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970884:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970889:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970895:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970901:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.970906:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971106:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971113:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971119:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971124:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971129:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971134:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971141:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971146:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971151:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971155:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971160:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971166:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971170:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971184:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971189:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971194:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971200:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971216:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971222:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971227:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971233:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971238:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971253:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971259:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971264:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971269:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971274:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971279:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971285:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971291:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971297:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971302:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971307:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971312:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971318:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971322:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971327:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971332:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971337:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971342:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971346:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971351:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971356:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971360:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971365:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971370:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971374:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971379:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971383:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.971388:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893347.971922:0:17189:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9fc9c877fc00:17189] 1 exiting: rc = 0 00000100:00100000:3.0:1787893347.972036:0:17188:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9fc9c877f600:17188] 0 exiting: rc = 1 00000100:00100000:2.0:1787893347.972123:0:18203:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9fc9fd014c00:18203] 2 exiting: rc = 0 00000100:00100000:1.0:1787893347.973792:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973804:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973828:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973835:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973862:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973869:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973875:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973883:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973889:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973895:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973902:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973924:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973931:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973941:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973948:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973954:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973978:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973986:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.973993:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974000:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974008:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974025:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974033:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974041:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974049:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974057:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974064:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974073:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974096:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974103:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974110:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974117:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974124:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974130:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974138:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974145:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974152:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974164:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974180:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974187:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974206:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974214:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974221:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974227:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974234:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974240:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974246:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974253:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974260:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974266:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974273:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974279:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974299:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974306:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974312:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974318:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974324:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974330:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974336:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974342:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974348:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974354:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974360:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.974367:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.983385:0:17190:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fc9c877e400:17190] 0 exiting: rc = 1 00000100:00100000:3.0:1787893347.983554:0:17191:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fc9d29f6c00:17191] 1 exiting: rc = 0 00000100:00100000:1.0:1787893347.983601:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983610:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983614:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983619:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983624:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983630:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983635:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983640:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983657:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983663:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983670:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983677:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983685:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983692:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983699:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983705:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983712:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983719:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983727:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983733:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983740:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983746:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983754:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983761:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983768:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983775:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983782:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983789:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983797:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983804:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983810:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983818:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983824:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983830:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983838:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983846:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983862:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983872:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983880:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983890:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983897:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983902:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983907:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.983995:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984000:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984004:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984020:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984025:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984030:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984034:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984039:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984045:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984050:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984055:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984060:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984066:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984072:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984080:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984086:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984092:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984099:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984104:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984110:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984118:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893347.984522:0:17193:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fc9c630dc00:17193] 1 exiting: rc = 0 00000100:00100000:2.0:1787893347.984612:0:17192:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fc9c2859200:17192] 0 exiting: rc = 1 00000100:00100000:1.0:1787893347.984746:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984754:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984761:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984768:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984776:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984784:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984791:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984798:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984808:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984815:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984825:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984834:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984844:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984854:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984874:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984880:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984884:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984889:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984894:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984899:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984904:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984987:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.984995:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985001:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985007:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985054:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985064:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985070:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985076:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985084:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985091:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985097:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985104:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985112:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985120:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985128:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985135:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985142:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985147:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985153:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985158:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985163:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985167:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985172:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985177:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985182:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985187:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985192:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985196:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985209:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985214:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985218:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985223:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985229:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985235:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985240:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985244:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985248:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985253:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985258:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985264:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985268:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985273:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.985277:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.985737:0:17195:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fc9e72c5200:17195] 1 exiting: rc = 0 00000100:00100000:3.0:1787893347.985917:0:17194:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fc8c8591200:17194] 0 exiting: rc = 1 00000100:00100000:1.0:1787893347.986004:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986022:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986028:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986033:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986039:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986045:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986050:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986056:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986061:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986067:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986072:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986077:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986083:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986090:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986095:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986100:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986106:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986112:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986117:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986123:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986137:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986143:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986149:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986154:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986159:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986164:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986169:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986174:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986180:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986185:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986190:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986195:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986200:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986206:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986212:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986218:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986224:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986229:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986234:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986240:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986246:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986251:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986257:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986263:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986269:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986274:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986279:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986285:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986290:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986295:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986301:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986307:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986312:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986318:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986323:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986335:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986341:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986347:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986352:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986358:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986363:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986369:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986375:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893347.986380:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.987091:0:17196:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9fc8c8591000:17196] 0 exiting: rc = 1 00000100:00100000:3.0:1787893347.987758:0:17197:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9fc8c8590200:17197] 1 exiting: rc = 0 00000100:00100000:0.0:1787893347.988297:0:17198:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9fc8c8591e00:17198] 2 exiting: rc = 0 00000100:00100000:2.0:1787893347.998117:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998128:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998136:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998142:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998147:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998154:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998159:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998179:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998185:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998190:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998195:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998201:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998207:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998212:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998218:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998223:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998228:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998233:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998238:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998244:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998265:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998278:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998287:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998293:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998298:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998303:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998309:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998315:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998321:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998326:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998338:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998343:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998348:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998353:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998359:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998364:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998370:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998376:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998381:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998386:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998392:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998398:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998410:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998415:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998433:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998439:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998445:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998450:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998457:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998465:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998470:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998476:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998482:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998488:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998511:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998517:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998525:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998532:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998539:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998547:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998553:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998559:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998564:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893347.998579:0:20973:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787893348.007405:0:20973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893348.007420:0:20973:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787893348.007426:0:20973:0:(genops.c:885:class_export_put()) final put ffff9fc8c8412800/MDS_uuid 00000020:00000080:3.0:1787893348.007430:0:20973:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c8412800/MDS_uuid for MDS 00000020:01000000:3.0:1787893348.007435:0:20973:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787893348.007613:0:20973:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1787893348.978916:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893350.007732:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893351.027059:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787893351.607904:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787893351.607914:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893351.607917:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787893351.607920:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787893351.607924:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7c6a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893351.607932:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 590 00000100:00080000:3.0:1787893351.607939:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787893351.607946:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc8c7c6a000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893351.608170:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711c700 x1874741493468928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893351.608238:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493468928:0@lo:38:kworker.0 00000400:00000100:1.0:1787893351.608294:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493468928 offset 0 length 520: 4 00000100:00080000:3.0:1787893351.609680:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787893351.609686:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787893351.609689:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffc1b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893351.609694:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 590 00000100:00080000:3.0:1787893351.609699:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787893351.609712:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc9ffc1b800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893351.609741:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711ed80 x1874741493469184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893351.609808:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493469056:0@lo:400:kworker.0 00000400:00000100:2.0:1787893351.609848:0:3632:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493469056 offset 0 length 224: 4 00000100:00100000:1.0:1787893351.614506:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493469184:0@lo:38:kworker.0 00000400:00000100:1.0:1787893351.614563:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493469184 offset 0 length 520: 4 00000100:00100000:2.0:1787893351.614952:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493469312:0@lo:400:kworker.0 00000400:00000100:2.0:1787893351.614989:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493469312 offset 0 length 224: 4 00000020:01000004:1.0:1787893351.669857:0:21174:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787893351.678147:0:21174:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787893351.678199:0:21174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893351.678211:0:21174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893351.678218:0:21174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893351.678226:0:21174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893351.678249:0:21174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787893351.678254:0:21174:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787893351.678280:0:21174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893351.678291:0:21174:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9e711c700 x1874741493468928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787893366 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893351.678317:0:21174:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787893351.678323:0:21174:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787893351.678328:0:21174:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7c6a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787893351.678332:0:21174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893351.678336:0:21174:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9e711c700 x1874741493468928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787893366 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893351.678342:0:21174:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787893351.678353:0:21174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1787893351.678420:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493468928:0@lo:38:kworker.0 00000100:00080000:3.0:1787893351.679271:0:21174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787893351.679282:0:21174:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9e711e300 x1874741493469056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893367 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893351.679299:0:21174:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787893351.679304:0:21174:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787893351.679324:0:21174:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7418000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787893351.679639:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493469056:0@lo:400:kworker.0 00000100:00100000:2.0:1787893351.679670:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1874741493469440:0@lo:39:umount.0 00000400:00000100:2.0:1787893351.679728:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493469440 offset 0 length 224: 4 00010000:00010000:0.0:1787893351.679839:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893351.679847:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893351.679862:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540800 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787893351.679866:0:19536:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893351.679876:0:19536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893351.679882:0:19536:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893351.679888:0:19536:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787893351.679890:0:19536:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787893351.679893:0:19536:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787893351.679909:0:19536:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc8c8416000 00010000:00010000:0.0:1787893351.679913:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893351.679921:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540800/0x9232577658cf1f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf1f8c expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893351.679933:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893351.679935:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893351.679937:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893352.050039:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787893352.625723:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787893352.625733:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893352.625736:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787893352.625739:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893352.625837:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493469568:0@lo:400:kworker.0 00000400:00000100:1.0:1787893352.625900:0:3630:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493469568 offset 0 length 224: 4 00010000:00010000:1.0:1787893353.075025:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787893353.139130:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787893353.139137:0:18699:0:(genops.c:885:class_export_put()) final put ffff9fc8c7f33000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787893353.139236:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7f33000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787893353.139366:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7f34000 for lustre-OST0000 00000001:00100000:3.0:1787893353.141794:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787893353.141802:0:19518:0:(genops.c:885:class_export_put()) final put ffff9fc8c5e4c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787893353.141943:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c5e4c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787893353.141999:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c5e4a800 for lustre-OST0001 00010000:00010000:0.0:1787893354.098073:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893355.121799:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893356.146089:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787893356.657841:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893356.657852:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893356.657855:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893356.657858:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893356.658029:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893356.658051:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493469696:0@lo:400:kworker.0 00000400:00000100:1.0:1787893356.658104:0:3630:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493469696 offset 0 length 224: 4 00010000:00010000:0.0:1787893357.169855:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893357.809878:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893347/real 1787893347] req@ffff9fc8c8480000 x1874741493468800/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787893357 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893357.809912:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc8c8480000 x1874741493468800/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787893357 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787893357.809942:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c8416000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893357.809964:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787893357.809968:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13b37fca-0eda-4b14-a6ef-4a378c945d17:3629:1874741493468800:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1787893357.810048:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893357.810053:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787893357.810056:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc8c8416000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893357.810060:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 591 00000100:00080000:0.0:1787893357.810065:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.135@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787893357.810071:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import ffff9fc8c8416000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893357.810113:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8480000 x1874741493469824/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787893357.810136:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893357.810140:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787893357.810302:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13b37fca-0eda-4b14-a6ef-4a378c945d17:3629:1874741493469824:0@lo:250:kworker.0 00000400:00000100:2.0:1787893357.810357:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874741493469824 offset 0 length 520: 4 00000100:00100000:3.0:1787893357.810367:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893357.810377:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493469952:0@lo:400:kworker.0 00000400:00000100:3.0:1787893357.810412:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493469952 offset 0 length 224: 4 00010000:00010000:2.0:1787893358.195969:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893359.218308:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893360.242011:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893361.265701:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893361.906452:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893351/real 1787893351] req@ffff9fc9e711fb80 x1874741493469440/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893361 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893361.906486:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9e711fb80 x1874741493469440/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893361 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787893361.906533:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7418000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787893361.906552:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1874741493469440:0@lo:39:umount.0 00000100:00080000:3.0:1787893361.906769:0:21174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787893361.906775:0:21174:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787893361.906779:0:21174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787893361.907820:0:21174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893361.907836:0:21174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893361.907843:0:21174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893361.907851:0:21174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893361.907892:0:21174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893361.907900:0:21174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893361.907922:0:21174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893361.907927:0:21174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893361.907933:0:21174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893361.907951:0:21174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787893361.907955:0:21174:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1787893361.907977:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000004:3.0:1787893361.907981:0:21174:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00010000:00010000:2.0:1787893361.907984:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1787893361.907985:0:21174:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787893361.907990:0:21174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893361.907995:0:21174:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:2.0:1787893361.907997:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c4153800 already unused, calling callback (ffffffffc129fc20) 00000020:00080000:3.0:1787893361.907999:0:21174:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9fc8c74c3370) has no exports 10000000:00010000:2.0:1787893361.908000:0:19536:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893361.908008:0:19536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893361.908015:0:19536:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787893361.908019:0:21174:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9fc8c74c3370) has no exports 10000000:01000000:2.0:1787893361.908020:0:19536:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893361.908022:0:19536:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787893361.908024:0:19536:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787893361.908036:0:19536:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc8c8416000 00010000:00010000:2.0:1787893361.908039:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893361.908046:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c4153800/0x9232577658cf1f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf1f62 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893361.908059:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893361.908062:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893361.908067:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893361.908070:0:19536:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893361.908076:0:19536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893361.908088:0:19536:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893361.908094:0:19536:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787893361.908096:0:19536:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787893361.908097:0:19536:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787893361.908103:0:19536:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc8c8416000 00010000:00010000:2.0:1787893361.908106:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893361.908112:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0200/0x9232577658cf22bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf22c6 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893361.908120:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893361.908122:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893361.908123:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893361.908769:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787893361.913925:0:21174:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc8c5d16900 - data ffff9fc9f4040d80/ffff9fc9ecc6cc00 00000020:01000000:3.0:1787893361.914077:0:21174:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc9c297dba0 - data ffff9fc8c5932510/ffff9fc9d04e7800 00100000:10000000:3.0:1787893361.940827:0:21174:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787893361.950400:0:21174:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1f70 00000020:00000080:3.0:1787893361.950412:0:21174:0:(genops.c:885:class_export_put()) final put ffff9fc9d3040000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787893361.950467:0:21174:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc8c8410800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787893361.950471:0:21174:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc8c8410800 2 00000020:01000004:3.0:1787893361.950474:0:21174:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc8c8410800 from lustre-OST0000 00000020:00000080:3.0:1787893361.950529:0:21174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893361.950538:0:21174:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787893361.950542:0:21174:0:(genops.c:885:class_export_put()) final put ffff9fc8c76ad800/lustre-OST0000_UUID 00000020:00000080:3.0:1787893361.950544:0:21174:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c76ad800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787893361.950562:0:21174:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787893361.950620:0:21174:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787893361.950625:0:21174:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787893361.950628:0:21174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893361.950634:0:21174:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787893361.950640:0:21174:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fc8c7c6e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893361.950646:0:21174:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9fc8c74c0000) has exports, disconnecting them 00000020:00080000:3.0:1787893361.950651:0:21174:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fc8c7c6e000), last request at 1787893274 00000020:00000080:3.0:1787893361.950655:0:21174:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1f9a 00000020:00080000:3.0:1787893361.950664:0:21174:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c7c6e000): rc 0 00000020:00000080:3.0:1787893361.950669:0:21174:0:(genops.c:885:class_export_put()) final put ffff9fc8c7c6e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787893361.954472:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9d3040000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787893361.954692:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7c6e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787893361.962653:0:21174:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787893361.962664:0:21174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787893361.962669:0:21174:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787893361.962693:0:21174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787893361.962908:0:21174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893361.962918:0:21174:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787893361.962923:0:21174:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787893361.962928:0:21174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893361.962932:0:21174:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787893361.962940:0:21174:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9fc8c741d800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787893361.962946:0:21174:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9fc8c74c4d28) has exports, disconnecting them 00000020:00080000:0.0:1787893361.962951:0:21174:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9fc8c741d800), last request at 1787893274 00000020:00000080:0.0:1787893361.962955:0:21174:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1faf 00000020:00080000:0.0:1787893361.962973:0:21174:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c741d800): rc 0 00000020:00000080:0.0:1787893361.962979:0:21174:0:(genops.c:885:class_export_put()) final put ffff9fc8c741d800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787893361.963634:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7c6a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787893361.963643:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc8c76ab000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787893361.963646:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c76ab000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787893361.963662:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787893361.963720:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c741d800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787893361.963740:0:21174:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787893361.963744:0:21174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787893361.963747:0:21174:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787893361.963752:0:21174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787893361.963770:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c7418000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787893361.963921:0:21174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893361.963928:0:21174:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787893361.963931:0:21174:0:(genops.c:885:class_export_put()) final put ffff9fc8c7c6b800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787893361.963933:0:21174:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7c6b800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787893361.963937:0:21174:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787893361.963966:0:21174:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc8c8410800 1 00000020:00000080:1.0:1787893361.963970:0:21174:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1f4d 00000020:00000080:1.0:1787893361.963975:0:21174:0:(genops.c:885:class_export_put()) final put ffff9fc9c3ead800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787893361.963982:0:21174:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787893361.963989:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c3ead800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787893361.963996:0:21174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893361.964000:0:21174:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787893361.964002:0:21174:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9fc9d9118000) has no exports 00000020:00000080:1.0:1787893362.055760:0:21174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893362.055773:0:21174:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787893362.055779:0:21174:0:(genops.c:885:class_export_put()) final put ffff9fc9c5170000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787893362.055784:0:21174:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c5170000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787893362.055796:0:21174:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787893362.056642:0:21174:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc9c5170800 00000020:02000400:1.0:1787893362.056691:0:21174:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787893362.297426:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787893362.865619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893362.865629:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893362.865632:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893362.865634:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893362.865813:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493470080:0@lo:400:kworker.0 00000400:00000100:1.0:1787893362.865887:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493470080 offset 0 length 224: 4 00010000:00010000:2.0:1787893363.313901:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893364.338088:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893365.368588:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893366.005220:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893351/real 1787893351] req@ffff9fc9e711ed80 x1874741493469184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787893366 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893366.005259:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9e711ed80 x1874741493469184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787893366 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893366.005284:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffc1b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893366.005315:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787893366.005320:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493469184:0@lo:38:kworker.0 00000100:00080000:1.0:1787893366.005356:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787893366.005361:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893366.005363:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787893366.005367:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787893366.005370:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffc1b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893366.005376:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 595 00000100:00080000:1.0:1787893366.005382:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787893366.005390:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc9ffc1b800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893366.005431:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fa529f80 x1874741493470208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893366.005509:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493470208:0@lo:38:kworker.0 00000400:00000100:1.0:1787893366.005570:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493470208 offset 0 length 520: 4 00000100:00100000:0.0:1787893366.006023:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893366.006037:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493470336:0@lo:400:kworker.0 00000400:00000100:0.0:1787893366.006065:0:3631:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493470336 offset 0 length 224: 4 00000020:01000004:0.0:1787893366.239369:0:21377:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787893366.261700:0:21377:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787893366.261961:0:21377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893366.261979:0:21377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893366.262003:0:21377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893366.262011:0:21377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893366.262038:0:21377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787893366.262047:0:21377:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787893366.262080:0:21377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787893366.262093:0:21377:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9fa529f80 x1874741493470208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787893386 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893366.262116:0:21377:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787893366.262124:0:21377:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787893366.262132:0:21377:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffc1b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787893366.262138:0:21377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787893366.262142:0:21377:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9fa529f80 x1874741493470208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787893386 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893366.262148:0:21377:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787893366.262151:0:21377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00010000:00010000:2.0:1787893366.262380:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893366.262389:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893366.262397:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9c147ca00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893366.262401:0:19536:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893366.262411:0:19536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893366.262430:0:19536:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893366.262436:0:19536:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893366.262438:0:19536:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787893366.262441:0:19536:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787893366.262458:0:19536:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc8c8416000 00010000:00010000:2.0:1787893366.262462:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893366.262468:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147ca00/0x9232577658cf20ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf20f1 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893366.262480:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893366.262482:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893366.262484:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893366.262575:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493470208:0@lo:38:kworker.0 00000100:00080000:0.0:1787893366.266206:0:21377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787893366.266232:0:21377:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9e711ea00 x1874741493469312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893367 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893366.266265:0:21377:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9c3e6c380 x1874741493469568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893368 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893366.266404:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493469312:0@lo:400:kworker.0 00000100:00100000:0.0:1787893366.266431:0:21377:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c8481500 x1874741493469696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893372 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893366.266442:0:21377:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c8483800 x1874741493469952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893373 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893366.266470:0:21377:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc8c8482680 x1874741493470080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893378 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893366.266478:0:21377:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9fa528e00 x1874741493470336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893382 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893366.267289:0:21377:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787893366.267301:0:21377:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787893366.267381:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493470336:0@lo:400:kworker.0 00000100:00100000:2.0:1787893366.272146:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493469568:0@lo:400:kworker.0 00000100:00100000:3.0:1787893366.276363:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493470080:0@lo:400:kworker.0 00000100:00100000:3.0:1787893366.276382:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493469952:0@lo:400:kworker.0 00000100:00080000:0.0:1787893366.280038:0:21377:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5e4b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787893366.280146:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1874741493470464:0@lo:39:umount.0 00000400:00000100:3.0:1787893366.280237:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741493470464 offset 0 length 224: 4 00000100:00100000:3.0:1787893366.284788:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493469696:0@lo:400:kworker.0 00010000:00010000:2.0:1787893366.385967:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893367.411986:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893368.439939:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893369.458651:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893370.482023:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787893371.057893:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787893371.057903:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787893371.505742:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893372.401774:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893357/real 1787893357] req@ffff9fc8c8480000 x1874741493469824/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787893372 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893372.401836:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc8c8480000 x1874741493469824/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787893372 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893372.401857:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c8416000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893372.401883:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787893372.401887:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13b37fca-0eda-4b14-a6ef-4a378c945d17:3629:1874741493469824:0@lo:250:kworker.0 00000100:00080000:3.0:1787893372.401977:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787893372.401982:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787893372.401985:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc8c8416000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893372.401990:0:38:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 601 00000100:00080000:3.0:1787893372.401994:0:38:0:(import.c:589:import_select_connection()) MGC192.168.202.135@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787893372.402007:0:38:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import ffff9fc8c8416000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893372.402035:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711ea00 x1874741493470592/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893372.402113:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13b37fca-0eda-4b14-a6ef-4a378c945d17:3629:1874741493470592:0@lo:250:kworker.0 00000400:00000100:1.0:1787893372.402163:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874741493470592 offset 0 length 520: 4 00010000:00010000:2.0:1787893372.529735:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893373.553730:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893374.577794:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893375.601942:0:17172:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893376.497697:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893366/real 1787893366] req@ffff9fc8c8483100 x1874741493470464/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893376 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893376.497732:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc8c8483100 x1874741493470464/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893376 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893376.497761:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5e4b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787893376.497784:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1874741493470464:0@lo:39:umount.0 00000100:00080000:0.0:1787893376.497873:0:21377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787893376.497878:0:21377:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787893376.497883:0:21377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787893376.498985:0:21377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893376.499001:0:21377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893376.499009:0:21377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893376.499016:0:21377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893376.499045:0:21377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893376.499053:0:21377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893376.499077:0:21377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893376.499083:0:21377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893376.499090:0:21377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893376.499111:0:21377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787893376.499116:0:21377:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787893376.499138:0:21377:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787893376.499142:0:21377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787893376.499147:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893376.499152:0:21377:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787893376.499156:0:21377:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9fc8c74c19b8) has no exports 00000020:00080000:0.0:1787893376.499179:0:21377:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9fc8c74c19b8) has no exports 00010000:00010000:2.0:1787893376.502355:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787893376.502375:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893376.502388:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893376.502407:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893376.502418:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893376.502425:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893376.502429:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893376.502431:0:17171:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787893376.502434:0:17171:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787893376.502450:0:17171:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc8c8416000 00010000:00010000:2.0:1787893376.502452:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893376.502457:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf20c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf20c7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893376.502468:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893376.502471:0:17171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893376.502475:0:17171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893376.502476:0:17171:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893376.502480:0:17171:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893376.502483:0:17171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893376.502541:0:17171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787893376.502543:0:17171:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787893376.502544:0:17171:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787893376.502550:0:17171:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc8c8416000 00010000:00010000:2.0:1787893376.502552:0:17171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893376.502555:0:17171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30200/0x9232577658cf22b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf22b8 expref: -99 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893376.502565:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893376.502567:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893376.502568:0:17171:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893376.504156:0:19536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787893376.507984:0:21377:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc9c297da80 - data ffff9fc9f4042360/ffff9fc9c4350000 00000020:01000000:0.0:1787893376.508128:0:21377:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc8c71ee600 - data ffff9fc9c8811000/ffff9fc9c43bc800 00100000:10000000:0.0:1787893376.515485:0:21377:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787893376.526193:0:21377:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf20d5 00000020:00000080:1.0:1787893376.526473:0:21377:0:(genops.c:885:class_export_put()) final put ffff9fc8c76ae800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787893376.526574:0:21377:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc8c64bb800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787893376.526579:0:21377:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc8c64bb800 2 00000020:01000004:1.0:1787893376.526582:0:21377:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc8c64bb800 from lustre-OST0001 00000020:00000080:1.0:1787893376.526614:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893376.526622:0:21377:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787893376.526625:0:21377:0:(genops.c:885:class_export_put()) final put ffff9fc8c7c68000/lustre-OST0001_UUID 00000020:00000080:1.0:1787893376.526628:0:21377:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c7c68000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787893376.526634:0:21377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787893376.526714:0:21377:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 13b37fca-0eda-4b14-a6ef-4a378c945d17->MGS 00010000:00010000:1.0:1787893376.526733:0:21377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7800/0x9232577658cf1e19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf1e20 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893376.526746:0:21377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7800/0x9232577658cf1e19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf1e20 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893376.526767:0:21377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787893376.526770:0:21377:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787893376.526773:0:21377:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787893376.526786:0:21377:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc8c8416000 00010000:00010000:1.0:1787893376.526790:0:21377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c84f7800/0x9232577658cf1e19 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf1e20 expref: -99 pid: 17915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893376.526804:0:21377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893376.526811:0:21377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893376.526816:0:21377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893376.526818:0:21377:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787893376.526820:0:21377:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787893376.526826:0:21377:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc8c8416000 00010000:00010000:1.0:1787893376.526829:0:21377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9c147c800/0x9232577658cf1d08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9232577658cf1d0f expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787893376.526842:0:21377:0:(import.c:65:import_set_state_nolock()) ffff9fc8c8416000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787893376.526846:0:21377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787893376.526848:0:21377:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787893376.526849:0:21377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787893376.526853:0:21377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787893376.526862:0:21377:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc9e711ea00 x1874741493470592/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787893392 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787893376.526887:0:21377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787893376.526890:0:21377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:2.0:1787893376.527688:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13b37fca-0eda-4b14-a6ef-4a378c945d17:3629:1874741493470592:0@lo:250:kworker.0 10000000:01000000:1.0:1787893376.527893:0:21377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787893376.527902:0:21377:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf1cf3 00000020:00000080:1.0:1787893376.527907:0:21377:0:(genops.c:885:class_export_put()) final put ffff9fc8c8413800/13b37fca-0eda-4b14-a6ef-4a378c945d17 00000020:00000080:3.0:1787893376.528476:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c76ae800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787893376.528659:0:21377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.135@tcp (flags='') 00000020:00000080:1.0:1787893376.528668:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893376.528675:0:21377:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.135@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787893376.528679:0:21377:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9fc8c7730000) has no exports 10000000:01000000:2.0:1787893376.528734:0:17180:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787893376.528883:0:21377:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.135@tcp: client import never connected 00000100:00080000:1.0:1787893376.528888:0:21377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787893376.528891:0:21377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787893376.528893:0:21377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787893376.528895:0:21377:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787893376.528929:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787893376.528934:0:21377:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.135@tcp (uuid 13b37fca-0eda-4b14-a6ef-4a378c945d17) 00000020:01000000:1.0:1787893376.528940:0:21377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787893376.528943:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787893376.528946:0:21377:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787893376.528952:0:21377:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fc9c3719000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787893376.528957:0:21377:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9fc9e735cd28) has exports, disconnecting them 00000020:00080000:1.0:1787893376.528961:0:21377:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fc9c3719000), last request at 1787893290 00000020:00000080:1.0:1787893376.528965:0:21377:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf20ff 00000020:00080000:1.0:1787893376.528976:0:21377:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc9c3719000): rc 0 00000020:00000080:1.0:1787893376.528980:0:21377:0:(genops.c:885:class_export_put()) final put ffff9fc9c3719000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787893376.530216:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c8413800/13b37fca-0eda-4b14-a6ef-4a378c945d17 for MGC192.168.202.135@tcp 00000020:00000080:3.0:1787893376.530230:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c8416000 for MGC192.168.202.135@tcp 00000020:00000080:3.0:1787893376.530237:0:37:0:(genops.c:885:class_export_put()) final put ffff9fc8c8410000/13b37fca-0eda-4b14-a6ef-4a378c945d17 00000020:00000080:3.0:1787893376.530239:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c8410000/13b37fca-0eda-4b14-a6ef-4a378c945d17 for MGC192.168.202.135@tcp 00000020:01000000:3.0:1787893376.530243:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.135@tcp (13b37fca-0eda-4b14-a6ef-4a378c945d17) 00000020:00000080:3.0:1787893376.530538:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c3719000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787893376.530566:0:21377:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787893376.530570:0:21377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893376.530575:0:21377:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787893376.530581:0:21377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787893376.530725:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893376.530732:0:21377:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1787893376.530738:0:21377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787893376.530743:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893376.530952:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc9ffc1b800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787893376.530960:0:37:0:(genops.c:885:class_export_put()) final put ffff9fc8c741a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787893376.530962:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c741a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787893376.530970:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787893376.531045:0:21377:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787893376.531053:0:21377:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9fc8c5e4e000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893376.531058:0:21377:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9fc8c71d99b8) has exports, disconnecting them 00000020:00080000:3.0:1787893376.531061:0:21377:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9fc8c5e4e000), last request at 1787893290 00000020:00000080:3.0:1787893376.531065:0:21377:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf2114 00000020:00080000:3.0:1787893376.531078:0:21377:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc8c5e4e000): rc 0 00000020:00000080:3.0:1787893376.531082:0:21377:0:(genops.c:885:class_export_put()) final put ffff9fc8c5e4e000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787893376.531260:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c5e4e000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787893376.533541:0:21377:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787893376.533550:0:21377:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787893376.533554:0:21377:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787893376.533561:0:21377:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787893376.533592:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc8c5e4b800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787893376.533652:0:17172:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787893376.533804:0:17171:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787893376.533888:0:19536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787893376.533978:0:17166:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fc9c3527800:17166] 0 exiting: rc = 1 00000100:00100000:2.0:1787893376.534067:0:17167:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fc9c3526600:17167] 1 exiting: rc = 0 00000100:00100000:2.0:1787893376.534119:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534396:0:17170:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fc9c3527200:17170] 2 exiting: rc = 0 00000100:00100000:2.0:1787893376.534458:0:17169:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fc9c3527e00:17169] 1 exiting: rc = 0 00000100:00100000:2.0:1787893376.534537:0:17168:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fc9fd079400:17168] 0 exiting: rc = 1 00000100:00100000:2.0:1787893376.534595:0:20974:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fc8c6789600:20974] 3 exiting: rc = 0 00000100:00100000:2.0:1787893376.534651:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534658:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534664:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534669:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534675:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534680:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534685:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534691:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534696:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534701:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534705:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534710:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534714:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534719:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534725:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534730:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534735:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534740:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534744:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534759:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534764:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534769:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534775:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534780:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534785:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534799:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534804:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534809:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534813:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534818:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534823:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534828:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534832:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534837:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534841:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534846:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534850:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534854:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534859:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534863:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534868:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534872:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534876:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534880:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534885:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534899:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534905:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534909:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534914:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534919:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534923:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534928:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534933:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534937:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534942:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534946:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534950:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534955:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534959:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534964:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534974:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534978:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534982:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.534988:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787893376.535591:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893376.535600:0:21377:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1787893376.535606:0:21377:0:(genops.c:885:class_export_put()) final put ffff9fc8c5e49800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1787893376.535610:0:21377:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c5e49800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1787893376.535616:0:21377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1787893376.535662:0:21377:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc8c64bb800 1 00000020:00000080:2.0:1787893376.535667:0:21377:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9232577658cf20b9 00000020:00000080:2.0:1787893376.535672:0:21377:0:(genops.c:885:class_export_put()) final put ffff9fc9fa48d800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787893376.535683:0:21377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787893376.535692:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9fa48d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787893376.535703:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893376.535708:0:21377:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787893376.535712:0:21377:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9fc9d911b370) has no exports 00000020:00000080:2.0:1787893376.687071:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893376.687085:0:21377:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787893376.687090:0:21377:0:(genops.c:885:class_export_put()) final put ffff9fc8c75ae800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787893376.687094:0:21377:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc8c75ae800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787893376.687105:0:21377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787893376.689601:0:21377:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc8c64be000 00000020:01000000:2.0:1787893376.689738:0:21377:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787893376.689757:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893376.689763:0:21377:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787893376.689767:0:21377:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9fc9ed57cd28) has no exports 00000020:00000080:2.0:1787893376.689795:0:21377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893376.689805:0:21377:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787893376.689810:0:21377:0:(genops.c:885:class_export_put()) final put ffff9fc9c3eaa800/OSS_uuid 00000020:00000080:2.0:1787893376.689813:0:21377:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc9c3eaa800/OSS_uuid for OSS 00000020:01000000:2.0:1787893376.689817:0:21377:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787893376.689860:0:17179:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787893376.690051:0:18703:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9fc9ec8b0a00:18703] 1 exiting: rc = 0 00000100:00100000:1.0:1787893376.690304:0:18702:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9fc9c761a800:18702] 0 exiting: rc = 1 00000100:00100000:1.0:1787893376.690357:0:19239:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9fc8c5c5f000:19239] 3 exiting: rc = 0 00000100:00100000:1.0:1787893376.690442:0:18704:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9fc9c631aa00:18704] 2 exiting: rc = 0 00000100:00100000:2.0:1787893376.690680:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690690:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690696:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690701:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690706:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690710:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690715:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690719:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690724:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690729:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690734:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690739:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.690744:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691576:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691582:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691588:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691594:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691599:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691604:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691609:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691614:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691619:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691625:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691630:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691635:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691641:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691646:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691652:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691658:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691663:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691669:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691674:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691680:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691699:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691704:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691709:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691714:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691720:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691725:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691731:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691737:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691742:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691756:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691762:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691768:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691777:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691783:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691788:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691794:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691799:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691805:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691811:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691816:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691822:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691827:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691832:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691838:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691844:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691849:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691856:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691862:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691867:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691873:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.691878:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787893376.698284:0:19991:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9fc9fa500200:19991] 2 exiting: rc = 0 00000100:00100000:1.0:1787893376.698654:0:18706:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fc9c4151a00:18706] 1 exiting: rc = 0 00000100:00100000:1.0:1787893376.698735:0:18705:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fc9fd03d200:18705] 0 exiting: rc = 1 00000100:00100000:2.0:1787893376.699741:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699761:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699766:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699772:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699786:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699791:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699796:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699801:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699807:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699812:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699818:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699823:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699828:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699834:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699839:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699845:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699849:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699854:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699859:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699864:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699870:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699875:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699881:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699887:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699892:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699897:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699901:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699906:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699912:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699916:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699921:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699927:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699933:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699939:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699945:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699950:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699954:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699960:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699964:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699977:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699982:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699987:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699993:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.699998:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700003:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700008:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700013:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700031:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700037:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700042:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700046:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700051:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700056:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700062:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700067:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700072:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700077:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700083:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700089:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700093:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700099:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700104:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700109:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.700114:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.701043:0:18709:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fc8c7705600:18709] 1 exiting: rc = 0 00000100:00100000:2.0:1787893376.701203:0:18708:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fc8c7704600:18708] 0 exiting: rc = 1 00000100:00100000:1.0:1787893376.702456:0:18710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fc9e7092800:18710] 2 exiting: rc = 0 00000100:00100000:2.0:1787893376.703540:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703549:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703554:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703559:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703565:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703570:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703576:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703602:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703620:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703626:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703631:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703637:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703643:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703650:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703656:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703662:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703668:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703674:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703679:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703684:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703689:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703695:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703700:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703705:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703710:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703715:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703720:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703726:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703730:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703736:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703741:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703773:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703780:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703785:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703790:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703796:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703802:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703808:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703813:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703819:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703824:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703830:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703835:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703848:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703853:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703859:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703865:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703870:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703876:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703882:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703888:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703894:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703899:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703904:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703910:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703918:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703935:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703943:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703950:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703956:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703969:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703976:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703982:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.703988:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.722316:0:18712:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fc9ddd6a600:18712] 1 exiting: rc = 0 00000100:00100000:2.0:1787893376.723139:0:18711:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fc9ddd6a000:18711] 0 exiting: rc = 1 00000100:00100000:2.0:1787893376.723203:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723210:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723214:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723219:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723223:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723228:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723233:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723237:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723241:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723247:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723251:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723256:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723276:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723281:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723286:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723292:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723297:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723303:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723308:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723314:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723318:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723323:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723328:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723333:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723339:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723345:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723350:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723355:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723523:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723533:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723538:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723544:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723549:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723555:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723564:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723569:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723575:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723580:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723586:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723592:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723597:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723602:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723607:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723611:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723617:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723623:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723629:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723641:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723646:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723651:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723656:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723661:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723667:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723674:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723680:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723686:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723691:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723697:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723702:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723706:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723712:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723717:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723722:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.723727:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893376.730266:0:18713:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fc8c66e8800:18713] 0 exiting: rc = 1 00000100:00100000:3.0:1787893376.732462:0:18714:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fc8c7101600:18714] 1 exiting: rc = 0 00000100:00100000:2.0:1787893376.732863:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732871:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732877:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732884:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732911:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732918:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732925:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732931:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732937:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732942:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732949:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732955:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732962:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732968:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732973:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.732980:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733001:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733010:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733023:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733029:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733037:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733043:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733050:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733057:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733064:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733070:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733077:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733083:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733102:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733108:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733114:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733131:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733139:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733145:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733152:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733159:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733166:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733172:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733179:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733186:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733204:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733211:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733216:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733222:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733228:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733235:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733244:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733250:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733255:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733261:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733267:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733273:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733289:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733299:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733305:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733312:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733318:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733323:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733329:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733336:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733344:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733349:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733355:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893376.733371:0:21377:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787893376.749808:0:21377:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787893399.473482:0:22143:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787893408.590952:0:22742:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787893408.590959:0:22742:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787893408.590960:0:22742:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787893408.591072:0:22742:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc9c425c800 00000020:01000004:3.0:1787893408.591087:0:22742:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787893408.591095:0:22742:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787893408.591107:0:22742:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fc9d91199b8) 00000020:00000080:3.0:1787893408.591121:0:22742:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787893408.699477:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787893408.700018:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.716103:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787893408.716731:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.717033:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.718399:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787893408.720821:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.724583:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.725324:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.725719:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.726058:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787893408.726406:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.727537:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.728077:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787893408.728477:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.728787:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.729282:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787893408.729594:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787893408.737823:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.738300:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.738584:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787893408.739084:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787893408.739392:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787893408.739772:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.740067:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787893408.740349:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787893408.743282:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787893408.744462:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787893408.744887:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787893408.746305:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787893408.746779:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787893408.747080:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787893408.747331:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787893408.747700:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787893408.760362:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.761882:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787893408.762908:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787893408.764034:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.764350:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787893408.764609:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.764852:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787893408.765339:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787893408.765615:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.765865:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.766140:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787893408.766371:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.766620:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.768444:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.769024:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.769444:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.769941:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.770162:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787893408.770528:0:22742:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1787893408.771678:0:22742:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787893408.771892:0:22742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787893408.771901:0:22742:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787893408.771924:0:22742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf2566 00000020:01000004:0.0:1787893408.771931:0:22742:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787893408.771936:0:22742:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787893408.771941:0:22742:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc9c425c800 from MGS 00000020:01000004:0.0:1787893408.771945:0:22742:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787893408.771954:0:22742:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fc8c71db370) 00000020:00000080:0.0:1787893408.771964:0:22742:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787893408.772021:0:22742:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9c425c800 from MGS, refs=2 00080000:01000000:0.0:1787893408.772026:0:22742:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787893408.772030:0:22742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf2574 00000100:00100000:0.0:1787893408.772125:0:22742:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787893408.772267:0:22742:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787893408.772273:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787893408.774879:0:22742:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787893408.774893:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787893408.776329:0:22742:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893408.778876:0:22742:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787893408.778889:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787893408.786355:0:22742:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787893408.786372:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787893408.787609:0:22742:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787893408.787629:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787893408.788652:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893408.788657:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893408.788659:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893408.789061:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893408.789065:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893408.789067:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893408.789763:0:22742:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:0.0:1787893408.800297:0:22742:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787893408.801330:0:22754:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00010000:00010000:2.0:1787893408.801402:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1787893408.801469:0:22742:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787893408.801528:0:22742:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787893408.802334:0:22742:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787893408.802780:0:22742:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893408.802952:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787893408.802958:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787893408.812581:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787893408.812598:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787893408.813082:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787893408.813089:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787893408.817070:0:22742:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787893408.817096:0:22742:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.135@tcp' 00000020:01000004:3.0:1787893408.817098:0:22742:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787893408.817131:0:22742:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.135@tcp (typ=mgc) 00000020:00000080:3.0:1787893408.817144:0:22742:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.135@tcp (ffff9fc9d911cd28) 00000020:00000080:3.0:1787893408.817159:0:22742:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787893408.817253:0:22742:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9c4258000@MGC192.168.202.135@tcp: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787893408.817403:0:22742:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.135@tcp-0 is initialized 00000040:01000000:3.0:1787893408.817410:0:22742:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787893408.819375:0:22759:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787893408.822360:0:22761:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787893408.822449:0:22742:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.135@tcp (uuid afca6d2b-351c-4adb-95b2-d9dd13744042) 00000020:00000080:0.0:1787893408.822481:0:22742:0:(genops.c:1385:class_connect()) connect: client afca6d2b-351c-4adb-95b2-d9dd13744042, cookie 0x9232577658cf2582 00000100:00080000:0.0:1787893408.822620:0:22742:0:(import.c:510:import_select_connection()) MGC192.168.202.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787893408.822690:0:22742:0:(import.c:624:import_select_connection()) MGC192.168.202.135@tcp: import ffff9fc9c4258000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893408.822729:0:22742:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8483480 x1874741493470720/t0(0) o250->MGC192.168.202.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893408.822799:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:afca6d2b-351c-4adb-95b2-d9dd13744042:3629:1874741493470720:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787893408.822873:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893408.822996:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493470720 00000100:00100000:1.0:1787893408.823004:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493470720 00000100:00100000:1.0:1787893408.823042:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787893408.823050:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3629:x1874741493470720:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787893408.823076:0:22755:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from afca6d2b-351c-4adb-95b2-d9dd13744042@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:1.0:1787893408.823101:0:22755:0:(genops.c:1385:class_connect()) connect: client afca6d2b-351c-4adb-95b2-d9dd13744042, cookie 0x9232577658cf2589 00000100:00080000:1.0:1787893408.823217:0:22755:0:(import.c:65:import_set_state_nolock()) ffff9fc8c8cf9800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787893408.824065:0:22742:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import afca6d2b-351c-4adb-95b2-d9dd13744042->MGS 00000020:01000004:0.0:1787893408.824086:0:22742:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787893408.824091:0:22742:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787893408.824105:0:22742:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fc8c71d8000) 00000020:00000080:0.0:1787893408.824115:0:22742:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787893408.832063:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+5:3629:x1874741493470720:12345-0@lo:250:mount.lustre.0 Request processed in 9002us (9178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893408.832079:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893408.832291:0:3629:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787893408.832303:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.135@tcp: connect to target with instance 0 00000100:00080000:2.0:1787893408.832312:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787893408.832317:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787893408.832321:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c4258000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787893408.832324:0:3629:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787893408.832341:0:3629:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787893408.832348:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:afca6d2b-351c-4adb-95b2-d9dd13744042:3629:1874741493470720:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787893408.840964:0:22742:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893408.841162:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787893408.842794:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787893408.844173:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787893408.844183:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787893408.844713:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787893408.844720:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787893408.846203:0:22742:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893408.846375:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787893408.846381:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787893408.849994:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787893408.850009:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787893408.905409:0:22742:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893408.906769:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787893408.906778:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787893408.909393:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787893408.909406:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787893408.910275:0:22742:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893408.910446:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787893408.910463:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787893408.911150:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787893408.911158:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787893408.911902:0:22742:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893408.912133:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787893408.912144:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787893408.913890:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787893408.913903:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787893408.914888:0:22742:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787893408.915151:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787893408.915157:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787893408.917037:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787893408.917048:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787893408.959934:0:22742:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893408.960158:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787893408.960165:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787893408.961469:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787893408.961479:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787893408.965068:0:22742:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787893408.965086:0:22742:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787893408.969850:0:22742:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787893408.969883:0:22742:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787893408.969890:0:22742:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787893408.970125:0:22742:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787893408.970159:0:22742:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.135@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787893408.970164:0:22742:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787893408.970244:0:22742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787893408.970246:0:22742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893408.970253:0:22742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893408.970254:0:22742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893408.970255:0:22742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893408.970257:0:22742:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787893408.970258:0:22742:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787893408.970260:0:22742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893408.970261:0:22742:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787893408.970264:0:22742:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787893408.970266:0:22742:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787893408.970267:0:22742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787893408.970268:0:22742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893408.970269:0:22742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893408.970270:0:22742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893408.970271:0:22742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893408.970272:0:22742:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787893408.970273:0:22742:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787893408.970273:0:22742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893408.970275:0:22742:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787893408.970311:0:22742:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787893408.970331:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493470848:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787893408.970400:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893408.970896:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd02ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893408.972762:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493470848 00000100:00100000:3.0:1787893408.972777:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493470848 00000100:00100000:3.0:1787893408.972887:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893408.972897:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+5:22742:x1874741493470848:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787893408.972958:0:22758:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787893408.972962:0:22758:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787893408.972965:0:22758:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787893408.973587:0:22779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787893408.974156:0:22758:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1787893408.975663:0:22780:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787893408.975669:0:22780:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787893408.975672:0:22780:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787893408.975675:0:22780:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787893408.975827:0:22780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787893408.976099:0:22758:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787893408.976109:0:22758:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787893408.977892:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+5:22742:x1874741493470848:12345-0@lo:253:mount.lustre.0 Request processed in 4988us (7483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893408.977915:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787893408.978086:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493470848:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787893408.978104:0:22742:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787893408.978107:0:22742:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787893408.978108:0:22742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787893408.978110:0:22742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893408.978111:0:22742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893408.978112:0:22742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893408.978113:0:22742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893408.978115:0:22742:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787893408.978117:0:22742:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787893408.978119:0:22742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893408.978120:0:22742:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787893408.978139:0:22742:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc9c425c800 from lustre-MDT0000 10000000:01000000:0.0:1787893408.978309:0:22742:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787893408.978313:0:22742:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787893408.978328:0:22742:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fc9d911cd28 10000000:01000000:0.0:1787893408.978332:0:22742:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787893408.978342:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc9d911cd28 from 1 10000000:01000000:0.0:1787893408.978345:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787893408.978385:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893408.978397:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893408.978406:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893408.978423:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493470976:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787893408.979020:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893408.979055:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd02a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787893408.979112:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493470976 00000100:00100000:1.0:1787893408.979118:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493470976 00000100:00100000:1.0:1787893408.979153:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787893408.979160:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+5:22742:x1874741493470976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893408.979180:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893408.979192:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540800/0x9232577658cf259e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2597 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893408.979211:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540800/0x9232577658cf259e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2597 expref: 6 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893408.979218:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540800/0x9232577658cf259e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2597 expref: 6 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893408.979225:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540800, rc 0) 00000100:00100000:1.0:1787893408.979334:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+6:22742:x1874741493470976:12345-0@lo:101:mount.lustre.0 Request processed in 173us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893408.979338:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787893408.981158:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493470976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893408.981195:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893408.981207:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893408.981463:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493471104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893408.981724:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893408.981769:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893408.981826:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493471104 00000100:00100000:2.0:1787893408.981832:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493471104 00000100:00100000:2.0:1787893408.981878:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787893408.981886:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+6:22742:x1874741493471104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893408.982000:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+6:22742:x1874741493471104:12345-0@lo:501:mount.lustre.0 Request processed in 114us (276us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787893408.982007:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787893408.982144:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493471104:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787893408.982184:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787893408.982205:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893408.982214:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893408.982225:0:22742:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc9c425c800 10000000:01000000:3.0:1787893408.982230:0:22742:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787893408.982235:0:22742:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc9c425c800 10000000:01000000:3.0:1787893408.982238:0:22742:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787893408.982241:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc9c425c800 from 1 10000000:01000000:3.0:1787893408.982259:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787893408.982286:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e600/0x9232577658cf25a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893408.982294:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e600/0x9232577658cf25a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893408.982303:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e600/0x9232577658cf25a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893408.982316:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493471232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893408.982343:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893408.982360:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893408.982580:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493471232 00000100:00100000:0.0:1787893408.982585:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493471232 00000100:00100000:0.0:1787893408.982619:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787893408.982627:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+6:22742:x1874741493471232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893408.982636:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893408.982650:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30800/0x9232577658cf25ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf25a5 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893408.982668:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30800/0x9232577658cf25ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf25a5 expref: 7 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893408.982677:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30800/0x9232577658cf25ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf25a5 expref: 7 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893408.982696:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30800, rc 0) 00000100:00100000:0.0:1787893408.982735:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+7:22742:x1874741493471232:12345-0@lo:101:mount.lustre.0 Request processed in 109us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893408.982740:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787893408.982941:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493471232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893408.982954:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e600/0x9232577658cf25a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf25ac expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893408.982962:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e600/0x9232577658cf25a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf25ac expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893408.982974:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787893408.982987:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e600/0x9232577658cf25a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf25ac expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893408.982995:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e600/0x9232577658cf25a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf25ac expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893408.983001:0:22742:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787893408.983004:0:22742:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787893408.983014:0:22742:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc9c425c800 10000000:01000000:3.0:1787893408.983017:0:22742:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787893408.983020:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787893408.983022:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787893408.983037:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ee00/0x9232577658cf25b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893408.983044:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ee00/0x9232577658cf25b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893408.983051:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ee00/0x9232577658cf25b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893408.983064:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493471360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893408.983092:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893408.983112:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893408.985255:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493471360 00000100:00100000:0.0:1787893408.985271:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493471360 00000100:00100000:0.0:1787893408.985343:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787893408.985353:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+7:22742:x1874741493471360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893408.985369:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893408.985387:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31800/0x9232577658cf25ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf25b3 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893408.985413:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31800/0x9232577658cf25ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf25b3 expref: 8 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893408.985423:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31800/0x9232577658cf25ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf25b3 expref: 8 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893408.985431:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31800, rc 0) 00000100:00100000:0.0:1787893408.985546:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+8:22742:x1874741493471360:12345-0@lo:101:mount.lustre.0 Request processed in 194us (2453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893408.985553:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893408.986031:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493471360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893408.986052:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ee00/0x9232577658cf25b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf25ba expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893408.986062:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ee00/0x9232577658cf25b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf25ba expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893408.986135:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493471488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893408.986318:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893408.986445:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893408.986723:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493471488 00000100:00100000:2.0:1787893408.986730:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493471488 00000100:00100000:2.0:1787893408.986814:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787893408.986824:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+8:22742:x1874741493471488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893408.986992:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+9:22742:x1874741493471488:12345-0@lo:501:mount.lustre.0 Request processed in 169us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893408.987000:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787893408.987079:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493471488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893408.987111:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493471616:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893408.987180:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893408.987206:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893408.987427:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493471616 00000100:00100000:2.0:1787893408.987432:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493471616 00000100:00100000:2.0:1787893408.987462:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787893408.987469:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+9:22742:x1874741493471616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893408.990979:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+9:22742:x1874741493471616:12345-0@lo:503:mount.lustre.0 Request processed in 3501us (3804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893408.991006:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893408.992702:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493471616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893408.993276:0:22781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa528e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22781:1874741493471744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893408.993345:0:22781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893408.993419:0:22781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d10103c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893408.993469:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493471744 00000100:00100000:0.0:1787893408.993477:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493471744 00000100:00100000:0.0:1787893408.993648:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787893408.993658:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+9:22781:x1874741493471744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893408.994318:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+9:22781:x1874741493471744:12345-0@lo:502:llog_process_th.0 Request processed in 659us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893408.994332:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787893408.994428:0:22781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa528e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22781:1874741493471744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787893408.994469:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893408.994481:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893408.994483:0:22781:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787893408.994488:0:22781:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787893408.994509:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787893408.994523:0:22781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fc9e735b370) 00000020:00000080:1.0:1787893408.994537:0:22781:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787893408.994542:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787893408.994637:0:22781:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787893408.994644:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf25c8 00000020:00000080:1.0:1787893408.994835:0:22781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787893408.994845:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893408.994849:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893408.994850:0:22781:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787893408.994853:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893408.994856:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893408.994857:0:22781:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787893408.994861:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787893408.994869:0:22781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fc9e735cd28) 00000020:00000080:1.0:1787893408.994879:0:22781:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787893408.994883:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787893408.994885:0:22781:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787893408.994887:0:22781:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787893408.994893:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787893408.994946:0:22781:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9c425c800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787893408.994959:0:22781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fc9e7358000) 00000020:00000080:1.0:1787893408.994968:0:22781:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787893408.995017:0:22781:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787893408.995023:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf25dd 00000020:00000080:1.0:1787893408.995110:0:22781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787893408.995116:0:22781:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787893408.995120:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9232577658cf25e4 00080000:01000000:1.0:1787893408.995126:0:22781:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787893408.995130:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf25eb 00010000:00010000:2.0:1787893409.077894:0:22781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787893409.078416:0:22781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1787893409.078862:0:22781:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787893409.079667:0:22781:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fc9ed57b370) 00000020:00000080:2.0:1787893409.079687:0:22781:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787893409.079765:0:22781:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787893409.079776:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf25f9 00000020:00000080:2.0:1787893409.088789:0:22781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787893409.094420:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9232577658cf2600 00000020:00000080:3.0:1787893409.094980:0:22781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787893409.094994:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893409.095201:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893409.095204:0:22781:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787893409.095209:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787893409.095212:0:22781:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787893409.095214:0:22781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893409.095215:0:22781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893409.095217:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787893409.095219:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893409.095221:0:22781:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787893409.095223:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893409.095228:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893409.095230:0:22781:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787893409.095234:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787893409.095286:0:22781:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787893409.095305:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893409.095308:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893409.095310:0:22781:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787893409.095313:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893409.095316:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893409.095317:0:22781:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787893409.095320:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787893409.095326:0:22781:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:00000080:3.0:1787893409.095354:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787893409.095372:0:22781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9fc9d911b370) 00000020:00000080:3.0:1787893409.095387:0:22781:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787893409.095393:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787893409.095482:0:22781:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787893409.095487:0:22781:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787893409.095536:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf260e 00010000:00080000:0.0:1787893409.095876:0:22781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9c7e94000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787893409.102084:0:22781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787893409.105650:0:22781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893409.105665:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787893409.105700:0:22781:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787893409.105720:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf2615 00000100:00080000:2.0:1787893409.105730:0:22781:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893409.105735:0:22781:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc9c7e94000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893409.105772:0:22781:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9c3e6c000 x1874741493471872/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893409.105795:0:22781:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787893409.105868:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893409.105873:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893409.105874:0:22781:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787893409.105877:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787893409.105880:0:22781:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1787893409.105882:0:22781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893409.105883:0:22781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893409.105884:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787893409.105886:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893409.105887:0:22781:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787893409.105896:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787893409.105900:0:22781:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787893409.105904:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1787893409.106216:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493471872:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787893409.106286:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1787893409.106368:0:22781:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787893409.106376:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787893409.106380:0:22781:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:2.0:1787893409.106401:0:22781:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787893409.106404:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787893409.106416:0:22781:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fc9ed5799b8) 00000020:00000080:2.0:1787893409.106428:0:22781:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787893409.106433:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787893409.106544:0:22781:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787893409.106551:0:22781:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787893409.106558:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf2623 00010000:00080000:2.0:1787893409.106598:0:22781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9ffb46800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787893409.106807:0:22781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1787893409.107814:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493471872 00000100:00100000:0.0:1787893409.107826:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493471872 00000100:00100000:0.0:1787893409.107874:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787893409.107883:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493471872:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1787893409.107900:0:22768:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1787893409.115959:0:22781:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787893409.116445:0:22781:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787893409.125400:0:22781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893409.126727:0:22781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:0.0:1787893409.138971:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3629:x1874741493471872:12345-0@lo:38:llog_process_th.0 Request processed in 31078us (32676us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787893409.138986:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787893409.139175:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893409.139182:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787893409.139186:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493471872:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787893409.141763:0:22781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1787893409.143191:0:22787:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787893409.143198:0:22787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787893409.148086:0:22781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893409.148101:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787893409.148144:0:22781:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787893409.148178:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf262a 00000100:00080000:2.0:1787893409.148189:0:22781:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893409.148196:0:22781:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc9ffb46800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893409.148233:0:22781:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9c3e6c000 x1874741493472000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893409.148278:0:22781:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787893409.148375:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493472000:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787893409.148441:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493472000 offset 0 length 520: 4 00000020:01000000:2.0:1787893409.148738:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893409.148744:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893409.148746:0:22781:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787893409.148749:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787893409.148752:0:22781:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787893409.148754:0:22781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893409.148755:0:22781:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893409.148757:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787893409.148759:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893409.148761:0:22781:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787893409.148763:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787893409.148767:0:22781:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787893409.148771:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893409.148772:0:22781:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787893409.148775:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787893409.148778:0:22781:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:2.0:1787893409.148800:0:22781:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787893409.148802:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787893409.148815:0:22781:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fc9ed57cd28) 00000020:00000080:2.0:1787893409.148829:0:22781:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787893409.148834:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787893409.148889:0:22781:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787893409.148895:0:22781:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787893409.148899:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9232577658cf2638 00010000:00080000:2.0:1787893409.148925:0:22781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c7747000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787893409.149123:0:22781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787893409.149186:0:22781:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787893409.149200:0:22781:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787893409.161713:0:22781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787893409.162125:0:22781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787893409.162291:0:22781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1787893409.170393:0:22789:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787893409.170402:0:22789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787893409.173045:0:22781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893409.173061:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787893409.173105:0:22781:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787893409.173128:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf263f 00000100:00080000:2.0:1787893409.173141:0:22781:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893409.173148:0:22781:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc8c7747000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893409.173184:0:22781:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9c3e6fb80 x1874741493472128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893409.173215:0:22781:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787893409.173280:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893409.173285:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893409.173287:0:22781:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787893409.173290:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893409.173294:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893409.173296:0:22781:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787893409.173298:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787893409.173300:0:22781:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787893409.173302:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893409.173304:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893409.173305:0:22781:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787893409.173307:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893409.173309:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893409.173310:0:22781:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787893409.173313:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787893409.173343:0:22781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22781:1874741493472256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893409.173719:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493472128:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787893409.173753:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493472128 offset 0 length 520: 4 00000100:00100000:2.0:1787893409.175526:0:22781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893409.175812:0:22781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58480 going to sleep for 11 seconds 00000100:00100000:1.0:1787893409.175950:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493472256 00000100:00100000:1.0:1787893409.175959:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493472256 00000100:00100000:1.0:1787893409.176008:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787893409.176016:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+9:22781:x1874741493472256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893409.176164:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+9:22781:x1874741493472256:12345-0@lo:502:llog_process_th.0 Request processed in 148us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893409.176171:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787893409.176362:0:22781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22781:1874741493472256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787893409.176391:0:22781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893409.176400:0:22781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893409.176402:0:22781:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787893409.176409:0:22781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787893409.176723:0:22742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787893409.176746:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787893409.176761:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ee00/0x9232577658cf25b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf25ba expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893409.176772:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ee00/0x9232577658cf25b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf25ba expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893409.176779:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9c425c800 from 1 10000000:01000000:0.0:1787893409.176782:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787893409.176816:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893409.176824:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893409.176834:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893409.176862:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493472384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787893409.176920:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893409.176947:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893409.176966:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493472384 00000100:00100000:0.0:1787893409.176970:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493472384 00000100:00100000:0.0:1787893409.176994:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787893409.177002:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+9:22742:x1874741493472384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893409.177011:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893409.177024:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31000/0x9232577658cf264d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2646 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893409.177045:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31000/0x9232577658cf264d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2646 expref: 10 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893409.177055:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31000/0x9232577658cf264d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2646 expref: 10 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893409.177064:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31000, rc 0) 00000100:00100000:0.0:1787893409.177091:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+10:22742:x1874741493472384:12345-0@lo:101:mount.lustre.0 Request processed in 89us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893409.177097:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787893409.177125:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493472384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893409.177137:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893409.177145:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893409.178103:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493472512:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787893409.178148:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893409.178168:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893409.178190:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493472512 00000100:00100000:0.0:1787893409.178194:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493472512 00000100:00100000:0.0:1787893409.178221:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787893409.178229:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+10:22742:x1874741493472512:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787893409.178243:0:22755:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787893409.178249:0:22755:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787893409.178312:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+10:22742:x1874741493472512:12345-0@lo:256:mount.lustre.0 Request processed in 83us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893409.178318:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787893409.178354:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493472512:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787893409.179928:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787893409.179956:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893409.179967:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893409.179974:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9c425c800 from 1 10000000:01000000:0.0:1787893409.179977:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787893409.180013:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893409.180020:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893409.180080:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893409.180099:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493472640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787893409.180154:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893409.180382:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893409.183415:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493472640 00000100:00100000:2.0:1787893409.183755:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493472640 00000100:00100000:3.0:1787893409.188147:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787893409.188162:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+10:22742:x1874741493472640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893409.188180:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893409.188362:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf265b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2654 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.188394:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf265b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2654 expref: 11 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.188405:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf265b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2654 expref: 11 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.188414:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f200, rc 0) 00000100:00100000:3.0:1787893409.188583:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+11:22742:x1874741493472640:12345-0@lo:101:mount.lustre.0 Request processed in 423us (8427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893409.188590:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787893409.202543:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493472640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893409.202841:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893409.202855:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893409.203099:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493472768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893409.203157:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893409.203207:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8d13d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893409.203276:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493472768 00000100:00100000:2.0:1787893409.203283:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493472768 00000100:00100000:2.0:1787893409.203345:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787893409.203355:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+11:22742:x1874741493472768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893409.203547:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+11:22742:x1874741493472768:12345-0@lo:501:mount.lustre.0 Request processed in 193us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893409.203555:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787893409.203758:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493472768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893409.203801:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493472896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893409.203845:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893409.203878:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37840 going to sleep for 11 seconds 00000100:00100000:2.0:1787893409.204220:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493472896 00000100:00100000:2.0:1787893409.204225:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493472896 00000100:00100000:2.0:1787893409.204261:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787893409.204270:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+11:22742:x1874741493472896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893409.204372:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+11:22742:x1874741493472896:12345-0@lo:503:mount.lustre.0 Request processed in 102us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893409.204379:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787893409.205526:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493472896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893409.206882:0:22791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22791:1874741493473024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893409.207062:0:22791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893409.207139:0:22791:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787893409.217861:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493473024 00000100:00100000:2.0:1787893409.217877:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493473024 00000100:00100000:2.0:1787893409.218131:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787893409.218144:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+11:22791:x1874741493473024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893409.221073:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+11:22791:x1874741493473024:12345-0@lo:502:llog_process_th.0 Request processed in 2923us (14001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893409.221087:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787893409.221220:0:22791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22791:1874741493473024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787893409.221257:0:22791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893409.221267:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893409.221269:0:22791:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787893409.221276:0:22791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9c425c800 00000020:00000080:0.0:1787893409.221279:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893409.221287:0:22791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893409.221289:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893409.221290:0:22791:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787893409.221303:0:22791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893409.221307:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893409.221308:0:22791:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787893409.221311:0:22791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9c425c800 00000020:00000080:0.0:1787893409.221314:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893409.221386:0:22791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893409.221390:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893409.221391:0:22791:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787893409.221393:0:22791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893409.221395:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893409.221396:0:22791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787893409.221400:0:22791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9c425c800 00000020:00000080:0.0:1787893409.221402:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893409.221420:0:22791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893409.221435:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893409.221437:0:22791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787893409.221440:0:22791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893409.221442:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893409.221444:0:22791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787893409.221455:0:22791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9c425c800 00000020:00000080:0.0:1787893409.221458:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787893409.221533:0:22791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22791:1874741493473152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893409.221591:0:22791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893409.237678:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493473152 00000100:00100000:3.0:1787893409.237693:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493473152 00000100:00100000:3.0:1787893409.237752:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787893409.237764:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+11:22791:x1874741493473152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787893409.237943:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+11:22791:x1874741493473152:12345-0@lo:502:llog_process_th.0 Request processed in 182us (16352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893409.237951:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787893409.239667:0:22791:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787893409.239703:0:22791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22791:1874741493473152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787893409.239741:0:22791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893409.239749:0:22791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893409.239752:0:22791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787893409.239759:0:22791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787893409.239879:0:22742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787893409.239911:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787893409.239933:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.239943:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893409.239993:0:22742:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787893409.239996:0:22742:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc9c425c800 10000000:01000000:3.0:1787893409.239999:0:22742:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc9c425c800 10000000:01000000:3.0:1787893409.240010:0:22742:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787893409.240016:0:22742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9c425c800 from 1 10000000:01000000:3.0:1787893409.240018:0:22742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787893409.240050:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f000/0x9232577658cf2662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.240057:0:22742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f000/0x9232577658cf2662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.240066:0:22742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f000/0x9232577658cf2662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893409.240085:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493473280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893409.240139:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893409.240176:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493473280 00000100:00100000:3.0:1787893409.240181:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493473280 00000100:00100000:3.0:1787893409.240214:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787893409.240221:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+11:22742:x1874741493473280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893409.240233:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893409.240244:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7ea00/0x9232577658cf2669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2662 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.240266:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7ea00/0x9232577658cf2669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2662 expref: 12 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.240276:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c7c7ea00/0x9232577658cf2669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2662 expref: 12 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.240285:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7ea00, rc 0) 00000100:00100000:3.0:1787893409.240316:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22742:x1874741493473280:12345-0@lo:101:mount.lustre.0 Request processed in 95us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893409.240329:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787893409.240363:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893409.240376:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493473280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893409.240394:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f000/0x9232577658cf2662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2669 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.240402:0:22742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f000/0x9232577658cf2662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf2669 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893409.240474:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493473408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893409.240519:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893409.240539:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493473408 00000100:00100000:3.0:1787893409.240544:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493473408 00000100:00100000:3.0:1787893409.240563:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787893409.240568:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22742:x1874741493473408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893409.240674:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22742:x1874741493473408:12345-0@lo:501:mount.lustre.0 Request processed in 104us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893409.240681:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787893409.240709:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893409.240721:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493473408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893409.240745:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493473536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893409.240785:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893409.240806:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493473536 00000100:00100000:3.0:1787893409.240809:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493473536 00000100:00100000:3.0:1787893409.240825:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787893409.240838:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22742:x1874741493473536:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893409.240912:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22742:x1874741493473536:12345-0@lo:503:mount.lustre.0 Request processed in 73us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893409.240919:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787893409.240947:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893409.240959:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493473536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893409.263863:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22795:1874741493473664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893409.264757:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893409.264802:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893409.268726:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493473664 00000100:00100000:3.0:1787893409.268744:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493473664 00000100:00100000:3.0:1787893409.268805:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787893409.268817:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22795:x1874741493473664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787893409.268999:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22795:x1874741493473664:12345-0@lo:502:llog_process_th.0 Request processed in 184us (4245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893409.269008:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787893409.269091:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22795:1874741493473664:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787893409.269157:0:22795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787893409.269173:0:22795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fc9d9118000) 00000020:00000080:3.0:1787893409.269210:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1787893409.269298:0:22795:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9c425c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787893409.269302:0:22795:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9c425c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787893409.269305:0:22795:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9c425c800 4 00010000:00080000:3.0:1787893409.269334:0:22795:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9c7e90800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787893409.291304:0:22795:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787893409.291553:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787893409.291609:0:22795:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787893409.291623:0:22795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9232577658cf2677 00000100:00080000:3.0:1787893409.291634:0:22795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787893409.291647:0:22795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fc9c7e90800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893409.291685:0:22795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711c000 x1874741493473792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787893409.291728:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493473792:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787893409.291813:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787893409.291875:0:22795:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787893409.291897:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787893409.291915:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787893409.291919:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893409.291924:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:3.0:1787893409.291928:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787893409.291932:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc9c7e94000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893409.291947:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711ed80 x1874741493473920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787893409.291962:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893409.291966:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893409.291969:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893409.291972:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787893409.291989:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493473920:0@lo:38:kworker.0 00000100:00100000:3.0:1787893409.292022:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893409.292066:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493473920 00000100:00100000:3.0:1787893409.292073:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493473920 00000100:00100000:3.0:1787893409.292102:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893409.292110:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493473920:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787893409.292132:0:22769:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787893409.292173:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493473920:12345-0@lo:38:kworker.0 Request processed in 62us (150us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787893409.292181:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787893409.292218:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893409.292224:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787893409.292227:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493473920:0@lo:38:kworker.0 00000100:00100000:2.0:1787893409.292688:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493473792 00000100:00100000:2.0:1787893409.292694:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493473792 00000100:00100000:2.0:1787893409.292728:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893409.292734:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493473792:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787893409.292793:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493473792:12345-0@lo:38:llog_process_th.0 Request processed in 58us (980us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787893409.292799:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893409.296065:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787893409.296078:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e90800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893409.296085:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787893409.296090:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493473792:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787893409.296253:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22795:1874741493474048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787893409.296328:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893409.296365:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c76863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893409.296719:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493474048 00000100:00100000:0.0:1787893409.296728:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493474048 00000100:00100000:0.0:1787893409.296777:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787893409.296789:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22795:x1874741493474048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893409.299047:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22795:x1874741493474048:12345-0@lo:502:llog_process_th.0 Request processed in 2252us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893409.299061:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787893409.299706:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22795:1874741493474048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787893409.299784:0:22795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22795:1874741493474176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787893409.299847:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893409.299879:0:22795:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787893409.299896:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493474176 00000100:00100000:3.0:1787893409.299902:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493474176 00000100:00100000:3.0:1787893409.299958:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787893409.299966:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22795:x1874741493474176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787893409.300079:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22795:x1874741493474176:12345-0@lo:502:llog_process_th.0 Request processed in 112us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893409.300098:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787893409.300141:0:22795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:afca6d2b-351c-4adb-95b2-d9dd13744042:22795:1874741493474176:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787893409.300158:0:22795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787893409.302323:0:22742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787893409.302364:0:22742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787893409.302384:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f000/0x9232577658cf2662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2669 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893409.302396:0:22742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f000/0x9232577658cf2662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2669 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787893409.302472:0:22742:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787893409.302474:0:22742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893409.302476:0:22742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893409.302477:0:22742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893409.302478:0:22742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893409.302480:0:22742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893409.302481:0:22742:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893409.302483:0:22742:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893409.302484:0:22742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893409.302486:0:22742:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787893409.302505:0:22742:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787893409.302508:0:22742:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787893409.302509:0:22742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893409.302510:0:22742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893409.302512:0:22742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893409.302513:0:22742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893409.302514:0:22742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893409.302515:0:22742:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893409.302516:0:22742:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893409.302517:0:22742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893409.302518:0:22742:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787893409.302543:0:22742:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787893409.305351:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493474304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787893409.305437:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893409.305514:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893409.305625:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493474304 00000100:00100000:0.0:1787893409.305639:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493474304 00000100:00100000:0.0:1787893409.305692:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787893409.305703:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22742:x1874741493474304:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787893409.305732:0:22757:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787893409.305745:0:22757:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787893409.335429:0:22757:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787893409.335459:0:22757:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787893409.336070:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22742:x1874741493474304:12345-0@lo:253:mount.lustre.0 Request processed in 30364us (30628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893409.336082:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:2.0:1787893409.336172:0:22779:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787893409.336179:0:22779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787893409.336201:0:22779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893409.336216:0:22779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb31000/0x9232577658cf264d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2646 expref: 11 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893409.336226:0:22779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893409.336263:0:22779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb31000/0x9232577658cf264d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf2646 expref: 11 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893409.336278:0:22779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9edb31000/0x9232577658cf264d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf2646 expref: 11 pid: 22755 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893409.336291:0:22779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493474432:0@lo:104: 00000100:00100000:2.0:1787893409.336329:0:22779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893409.336362:0:22779:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9eee58540 going to sleep for 11 seconds 00000100:00100000:2.0:1787893409.336399:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:22742:1874741493474304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787893409.336410:0:22742:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787893409.336414:0:22742:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787893409.336415:0:22742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893409.336417:0:22742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893409.336418:0:22742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893409.336419:0:22742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893409.336420:0:22742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893409.336422:0:22742:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893409.336424:0:22742:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893409.336425:0:22742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893409.336427:0:22742:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787893409.336461:0:22742:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787893409.347480:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493474432 00000100:00100000:3.0:1787893409.347509:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493474432 00000100:00100000:3.0:1787893409.347573:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893409.347583:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+3:22779:x1874741493474432:12345-0@lo:104: 00010000:00010000:3.0:1787893409.347600:0:22746:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.347673:0:22746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787893409.347678:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+3:22779:x1874741493474432:12345-0@lo:104: Request processed in 97us (11350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893409.347682:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893409.350252:0:22779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493474432:0@lo:104: 00010000:00010000:3.0:1787893409.350286:0:22779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.351568:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893409.351581:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.351593:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893409.351598:0:22752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.351610:0:22752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893409.351647:0:22752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893409.351654:0:22752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787893409.351711:0:22752:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.351921:0:22752:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893409.351944:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.351953:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31e00/0x9232577658cf2646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf264d expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.351974:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893409.351976:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893409.351978:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893409.352103:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afca6d2b-351c-4adb-95b2-d9dd13744042:3631:1874741493474560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893409.352169:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893409.353645:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493474560 00000100:00100000:3.0:1787893409.353657:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493474560 00010000:00010000:3.0:1787893409.353692:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb31000/0x9232577658cf264d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2646 expref: 12 pid: 22755 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893409.353735:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893409.353743:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+12:3631:x1874741493474560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893409.353756:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893409.353761:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb31000/0x9232577658cf264d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2646 expref: 12 pid: 22755 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.353781:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb31000/0x9232577658cf264d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf2646 expref: 12 pid: 22755 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.353798:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31000/0x9232577658cf264d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf2646 expref: 12 pid: 22755 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.353815:0:22748:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.353823:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787893409.353840:0:22748:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017661601s 00010000:00010000:3.0:1787893409.353844:0:22748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.353852:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.353859:0:22748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.353866:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.353872:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893409.353877:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.353885:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.353921:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.353933:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893409.353996:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+11:3631:x1874741493474560:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893409.354004:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787893409.354032:0:22779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.354040:0:22779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893409.354046:0:22779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c67e1400/0x9232577658cf267e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893409.354102:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afca6d2b-351c-4adb-95b2-d9dd13744042:3631:1874741493474560:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787893409.378019:0:22742:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:3.0:1787893409.378631:0:22742:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787893409.378785:0:22803:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:2.0:1787893409.378789:0:22803:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:2.0:1787893409.386393:0:22804:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787893409.387070:0:22804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893409.392074:0:22804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787893409.392164:0:22804:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1787893409.392453:0:22742:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:2.0:1787893409.397960:0:22742:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787893409.398002:0:22742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787893409.398423:0:22742:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787893409.398431:0:22742:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787893409.398479:0:22742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893409.399430:0:22742:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787893409.400000:0:22742:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787893409.400035:0:22742:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00080000:3.0:1787893409.401426:0:22805:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9fc9e711c000 x1874741493474688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893409.401441:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00000040:00080000:3.0:1787893409.405973:0:22742:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1787893409.406854:0:22742:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1787893409.409316:0:22742:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1787893409.411041:0:22742:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787893409.411073:0:22742:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbaa0c1a53988 00100000:10000000:3.0:1787893409.411080:0:22742:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787893409.412209:0:22742:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787893409.412224:0:22742:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787893409.412242:0:22742:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1787893409.412256:0:22742:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787893409.412902:0:22742:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787893409.413557:0:22742:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787893409.844382:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787893410.228643:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787893410.228650:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9c425c800 from 11 10000000:01000000:1.0:1787893410.228656:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787893410.228702:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893410.228713:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893410.228725:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893410.228748:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493474816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787893410.228824:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893410.228906:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d90b93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893410.234056:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493474816 00000100:00100000:3.0:1787893410.234073:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493474816 00000100:00100000:3.0:1787893410.234174:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787893410.234185:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+11:22761:x1874741493474816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893410.234215:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893410.234235:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf268c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2685 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893410.234261:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf268c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2685 expref: 12 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893410.234272:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf268c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2685 expref: 12 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893410.234281:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e000, rc 0) 00000100:00100000:3.0:1787893410.234362:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22761:x1874741493474816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (5538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893410.234369:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787893410.234427:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493474816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893410.234454:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893410.234464:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893410.234564:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493474944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787893410.234600:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893410.234629:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c108e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893410.234829:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493474944 00000100:00100000:2.0:1787893410.234834:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493474944 00000100:00100000:2.0:1787893410.234871:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787893410.234879:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22761:x1874741493474944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787893410.234893:0:22758:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787893410.234908:0:22758:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787893410.234911:0:22758:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787893410.234991:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:22761:x1874741493474944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893410.234998:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787893410.242652:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493474944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787893410.242736:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787893410.242746:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893410.242757:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893410.290306:0:22796:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787893410.290316:0:22796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893410.291523:0:22796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787893410.291534:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787893410.430925:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:3.0:1787893410.868007:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787893411.318335:0:22796:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787893411.318349:0:22796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787893411.318595:0:22796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1787893411.318644:0:22796:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787893411.318844:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1787893411.441657:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:2.0:1787893411.889690:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893412.468222:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:2.0:1787893412.913655:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893413.500601:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:1.0:1787893413.939657:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787893414.191128:0:23048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787893414.513758:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00000100:00100000:0.0:1787893414.578002:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493475072:0@lo:400:kworker.0 00000100:00100000:0.0:1787893414.578133:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787893414.578269:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787893414.578285:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787893414.578289:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893414.578304:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 653 00000100:00080000:2.0:1787893414.578309:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787893414.578316:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc9c7e94000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893414.578339:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9c3e6f480 x1874741493475200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893414.578356:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893414.578359:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893414.578362:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893414.578365:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893414.578367:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787893414.578371:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787893414.578372:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e90800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893414.578377:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fc9c7e90800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893414.578387:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9c3e6d500 x1874741493475328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787893414.579088:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493475072 00000100:00100000:3.0:1787893414.579098:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493475072 00000100:00100000:3.0:1787893414.579144:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787893414.579152:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:3632:x1874741493475072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893414.581854:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493475200:0@lo:38:kworker.0 00000100:00100000:1.0:1787893414.581957:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893414.582113:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493475328:0@lo:38:kworker.0 00000100:00100000:1.0:1787893414.582146:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893414.582237:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493475328 00000100:00100000:2.0:1787893414.582247:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493475328 00000100:00100000:2.0:1787893414.582288:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893414.582295:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493475328:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787893414.582461:0:22765:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:2.0:1787893414.582535:0:22765:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9232577658cf2693 00000004:00100000:2.0:1787893414.582551:0:22765:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787893414.582686:0:22765:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7f30000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893414.582751:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1874741493475328:12345-0@lo:38:kworker.0 Request processed in 455us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893414.582759:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787893414.583879:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc9c3e6d500 x1874741493475328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893414.583900:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787893414.583908:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787893414.583912:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787893414.583915:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e90800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787893414.583922:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3629:1874741493475328:0@lo:38:kworker.0 00000100:00100000:2.0:1787893414.585644:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493475200 00000100:00100000:2.0:1787893414.585657:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493475200 00000100:00100000:2.0:1787893414.585691:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787893414.585699:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493475200:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787893414.591279:0:22769:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787893414.591539:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493475200:12345-0@lo:38:kworker.0 Request processed in 5837us (9579us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787893414.591552:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787893414.591734:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893414.591740:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787893414.591744:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493475200:0@lo:38:kworker.0 00000100:00100000:3.0:1787893414.592663:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:3632:x1874741493475072:12345-0@lo:400:kworker.0 Request processed in 13506us (14526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893414.592674:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787893414.592870:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493475072:0@lo:400:kworker.0 00010000:00010000:2.0:1787893414.961784:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787893415.261110:0:23100:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787893415.261612:0:23100:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787893415.540595:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:1.0:1787893415.986286:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787893416.200269:0:23150:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787893416.200735:0:23150:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787893416.563191:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:3.0:1787893417.023707:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893417.585582:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:3.0:1787893418.036146:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893418.611015:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:3.0:1787893419.057621:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893419.633600:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00000100:00100000:1.0:1787893419.697663:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893409/real 1787893409] req@ffff9fc9c3e6fb80 x1874741493472128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893419 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893419.697720:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9c3e6fb80 x1874741493472128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893419 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893419.697730:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893409/real 1787893409] req@ffff9fc9c3e6c000 x1874741493472000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893419 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893419.697741:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9c3e6c000 x1874741493472000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893419 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893419.697760:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7747000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893419.697782:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787893419.697785:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493472128:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787893419.697791:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb46800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893419.697796:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787893419.697799:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493472000:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787893419.697957:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afca6d2b-351c-4adb-95b2-d9dd13744042:3633:1874741493475456:0@lo:400:kworker.0 00000100:00100000:1.0:1787893419.698021:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893419.698081:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493475456 00000100:00100000:1.0:1787893419.698089:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493475456 00000100:00100000:1.0:1787893419.698134:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787893419.698142:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+12:3633:x1874741493475456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893419.698188:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+12:3633:x1874741493475456:12345-0@lo:400:kworker.0 Request processed in 47us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893419.698195:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787893419.698237:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afca6d2b-351c-4adb-95b2-d9dd13744042:3633:1874741493475456:0@lo:400:kworker.0 00000100:00080000:3.0:1787893419.703053:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787893419.703063:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787893419.703085:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893419.703093:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 658 00000100:00080000:3.0:1787893419.703099:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787893419.703107:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc9c7e94000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893419.703148:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711c700 x1874741493475584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787893419.703175:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893419.703179:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787893419.703180:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb46800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893419.703184:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:3.0:1787893419.703187:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787893419.703189:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc9ffb46800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893419.703198:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711d180 x1874741493475712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787893419.703206:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893419.703209:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787893419.703210:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7747000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893419.703213:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:3.0:1787893419.703215:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787893419.703218:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc8c7747000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893419.703225:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711f480 x1874741493475840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787893419.703275:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893419.703289:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493475968:0@lo:400:kworker.0 00000100:00100000:3.0:1787893419.703374:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893419.704111:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493475968 00000100:00100000:0.0:1787893419.704119:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493475968 00000100:00100000:0.0:1787893419.704168:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787893419.704177:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493475968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893419.704236:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3631:x1874741493475968:12345-0@lo:400:kworker.0 Request processed in 60us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893419.704250:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787893419.704347:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc9e711f100 x1874741493475968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893419.704370:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3631:1874741493475968:0@lo:400:kworker.0 00000100:00100000:1.0:1787893419.705463:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493475584:0@lo:38:kworker.0 00000100:00100000:1.0:1787893419.705720:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893419.705751:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493475712:0@lo:8:kworker.0 00000400:00000100:1.0:1787893419.705769:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493475712 offset 0 length 520: 4 00000100:00100000:1.0:1787893419.705787:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493475840:0@lo:8:kworker.0 00000400:00000100:1.0:1787893419.705800:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493475840 offset 0 length 520: 4 00000100:00100000:2.0:1787893419.706227:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493475584 00000100:00100000:2.0:1787893419.706234:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493475584 00000100:00100000:2.0:1787893419.706271:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787893419.706279:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493475584:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787893419.706297:0:22769:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787893419.706347:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493475584:12345-0@lo:38:kworker.0 Request processed in 67us (627us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787893419.706363:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787893419.706465:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893419.706470:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787893419.706474:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493475584:0@lo:38:kworker.0 00010000:00010000:3.0:1787893420.082175:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893420.657596:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:3.0:1787893421.106639:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787893421.555544:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787893421.681716:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:3.0:1787893422.130345:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893422.708864:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00000020:01000004:1.0:1787893423.006386:0:23496:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787893423.006390:0:23496:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787893423.006392:0:23496:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787893423.006538:0:23496:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc9ffc1a000 00000020:01000004:1.0:1787893423.006555:0:23496:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1787893423.006568:0:23496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787893423.006691:0:23496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9fc8c71dcd28) 00000020:00000080:0.0:1787893423.006709:0:23496:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787893423.068102:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787893423.069376:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787893423.071666:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1787893423.071952:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787893423.072558:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787893423.072754:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787893423.073084:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787893423.073664:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787893423.074042:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787893423.074338:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787893423.074547:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787893423.078651:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787893423.080467:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787893423.081039:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787893423.081258:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787893423.081521:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787893423.081690:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787893423.081921:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787893423.082074:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787893423.082269:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787893423.082479:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787893423.082969:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787893423.083220:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1787893423.083392:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787893423.083565:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787893423.083720:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787893423.083982:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1787893423.084216:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787893423.084467:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787893423.084839:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1787893423.084998:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1787893423.085284:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787893423.085518:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787893423.085832:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787893423.086278:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1787893423.086516:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787893423.086728:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1787893423.087583:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1787893423.088242:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787893423.088709:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787893423.089252:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787893423.089445:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787893423.089764:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787893423.090008:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787893423.090220:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787893423.090444:0:23496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:0.0:1787893423.093094:0:23496:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787893423.093804:0:23496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787893423.093815:0:23496:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787893423.093825:0:23496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf26a1 00000020:01000004:0.0:1787893423.093831:0:23496:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787893423.093847:0:23496:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787893423.093849:0:23496:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787893423.093853:0:23496:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787893423.093873:0:23496:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787893423.093876:0:23496:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787893423.097960:0:23496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787893423.097999:0:23496:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.135@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1787893423.098002:0:23496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787893423.098003:0:23496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787893423.098004:0:23496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893423.098005:0:23496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893423.098006:0:23496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893423.098007:0:23496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893423.098008:0:23496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787893423.098009:0:23496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893423.098010:0:23496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787893423.098013:0:23496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1787893423.098014:0:23496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787893423.098015:0:23496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787893423.098016:0:23496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893423.098016:0:23496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893423.098017:0:23496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893423.098018:0:23496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893423.098018:0:23496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787893423.098019:0:23496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893423.098020:0:23496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787893423.098043:0:23496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787893423.098063:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476096:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787893423.098122:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893423.098213:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493476096 00000100:00100000:3.0:1787893423.098230:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493476096 00000100:00100000:0.0:1787893423.098231:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c671fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.098283:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787893423.098293:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:23496:x1874741493476096:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787893423.098333:0:22758:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787893423.098336:0:22758:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787893423.098345:0:22758:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787893423.098565:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:23496:x1874741493476096:12345-0@lo:253:mount.lustre.0 Request processed in 272us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.098578:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787893423.098842:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476096:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787893423.098850:0:23496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787893423.098852:0:23496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787893423.098853:0:23496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787893423.098854:0:23496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893423.098854:0:23496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893423.098855:0:23496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893423.098856:0:23496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893423.098857:0:23496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787893423.098858:0:23496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893423.098858:0:23496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787893423.098872:0:23496:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc9ffc1a000 from lustre-MDT0001 10000000:01000000:0.0:1787893423.098891:0:23496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787893423.098892:0:23496:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787893423.098897:0:23496:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc9d911cd28 local copy 00010000:00010000:0.0:1787893423.098904:0:23496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893423.098958:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893423.098978:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893423.099033:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c671fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893423.099058:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493476224 00000100:00100000:1.0:1787893423.099062:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493476224 00000100:00100000:1.0:1787893423.099092:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787893423.099099:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+12:23496:x1874741493476224:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893423.099423:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+12:23496:x1874741493476224:12345-0@lo:501:mount.lustre.0 Request processed in 324us (442us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787893423.099428:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787893423.099484:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476224:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787893423.099596:0:23496:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787893423.099616:0:23496:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787893423.099622:0:23496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.099630:0:23496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893423.099667:0:23496:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc9ffc1a000 10000000:01000000:1.0:1787893423.099672:0:23496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787893423.099677:0:23496:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fc9d911cd28 10000000:01000000:1.0:1787893423.099679:0:23496:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787893423.099683:0:23496:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fc9d911cd28 from 1 10000000:01000000:1.0:1787893423.099686:0:23496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787893423.099709:0:23496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf26a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.099717:0:23496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf26a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.099726:0:23496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf26a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893423.099832:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893423.099853:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.099876:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.099895:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493476352 00000100:00100000:3.0:1787893423.099900:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493476352 00000100:00100000:3.0:1787893423.099931:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787893423.099936:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+12:23496:x1874741493476352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893423.099943:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893423.099952:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7f600/0x9232577658cf26af lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf26a8 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.099967:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7f600/0x9232577658cf26af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf26a8 expref: 13 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.099973:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c7c7f600/0x9232577658cf26af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf26a8 expref: 13 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.099980:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7f600, rc 0) 00000100:00100000:3.0:1787893423.100007:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+13:23496:x1874741493476352:12345-0@lo:101:mount.lustre.0 Request processed in 70us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.100013:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787893423.100036:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893423.100048:0:23496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf26a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf26af expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.100057:0:23496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf26a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf26af expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893423.100072:0:23496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787893423.100112:0:23496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf26a8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf26af expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.100126:0:23496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540400/0x9232577658cf26a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf26af expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893423.100139:0:23496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc9ffc1a000 10000000:01000000:1.0:1787893423.100142:0:23496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787893423.100144:0:23496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc9ffc1a000 from 1 10000000:01000000:1.0:1787893423.100145:0:23496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787893423.100156:0:23496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf26b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.100160:0:23496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf26b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.100165:0:23496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf26b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893423.100172:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893423.100189:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.100204:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893423.100235:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493476480 00000100:00100000:2.0:1787893423.100239:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493476480 00000100:00100000:2.0:1787893423.100271:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787893423.100279:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+13:23496:x1874741493476480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893423.100285:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893423.100294:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e0800/0x9232577658cf26bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf26b6 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893423.100307:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e0800/0x9232577658cf26bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf26b6 expref: 14 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893423.100316:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c67e0800/0x9232577658cf26bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf26b6 expref: 14 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893423.100336:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0800, rc 0) 00000100:00100000:2.0:1787893423.100366:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+14:23496:x1874741493476480:12345-0@lo:101:mount.lustre.0 Request processed in 88us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.100372:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787893423.100394:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893423.100404:0:23496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf26b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf26bd expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.100411:0:23496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf26b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf26bd expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893423.100421:0:23496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787893423.100435:0:23496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf26b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf26bd expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.100447:0:23496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541c00/0x9232577658cf26b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf26bd expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893423.100453:0:23496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787893423.100457:0:23496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787893423.100461:0:23496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc9ffc1a000 10000000:01000000:1.0:1787893423.100464:0:23496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787893423.100467:0:23496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787893423.100469:0:23496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787893423.100484:0:23496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf26c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.100515:0:23496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf26c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.100522:0:23496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf26c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893423.100534:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893423.100559:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.100583:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893423.100808:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493476608 00000100:00100000:2.0:1787893423.100813:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493476608 00000100:00100000:2.0:1787893423.100845:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787893423.100853:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+14:23496:x1874741493476608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893423.100860:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893423.100869:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e1800/0x9232577658cf26cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf26c4 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893423.100883:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e1800/0x9232577658cf26cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf26c4 expref: 15 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893423.100891:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c67e1800/0x9232577658cf26cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf26c4 expref: 15 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893423.100898:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1800, rc 0) 00000100:00100000:2.0:1787893423.100928:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+15:23496:x1874741493476608:12345-0@lo:101:mount.lustre.0 Request processed in 76us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.100934:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787893423.100956:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476608:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893423.100967:0:23496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf26c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf26cb expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.100974:0:23496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf26c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf26cb expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787893423.102007:0:23496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1787893423.102447:0:23496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787893423.105898:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787893423.105954:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1787893423.105969:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1787893423.105981:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1787893423.105992:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1787893423.106004:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1787893423.106015:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1787893423.106028:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1787893423.106040:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1787893423.106051:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1787893423.106063:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1787893423.106074:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1787893423.106085:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1787893423.106097:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1787893423.106109:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1787893423.106122:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1787893423.106217:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1787893423.106235:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1787893423.106249:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1787893423.106262:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1787893423.106276:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1787893423.106287:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1787893423.106299:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1787893423.106312:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1787893423.106338:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1787893423.106350:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1787893423.106361:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1787893423.106373:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1787893423.106385:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1787893423.106410:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1787893423.106427:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1787893423.106441:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1787893423.106454:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1787893423.106466:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1787893423.106478:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1787893423.106612:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1787893423.106633:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1787893423.106648:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1787893423.106662:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1787893423.106675:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1787893423.106688:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1787893423.106700:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1787893423.106714:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1787893423.106727:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1787893423.106887:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1787893423.106894:0:23496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1787893423.107008:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893423.107071:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.107249:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.107293:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493476736 00000100:00100000:3.0:1787893423.107301:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493476736 00000100:00100000:3.0:1787893423.107386:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787893423.107395:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+15:23496:x1874741493476736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893423.107753:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+15:23496:x1874741493476736:12345-0@lo:501:mount.lustre.0 Request processed in 358us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.107761:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787893423.107910:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893423.107938:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893423.107971:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.107999:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893423.108024:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493476864 00000100:00100000:2.0:1787893423.108029:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493476864 00000100:00100000:2.0:1787893423.108057:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787893423.108064:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+15:23496:x1874741493476864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893423.108580:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+15:23496:x1874741493476864:12345-0@lo:503:mount.lustre.0 Request processed in 515us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.108588:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787893423.108599:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476864:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787893423.109050:0:23496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787893423.109106:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893423.109199:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.109237:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.109263:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493476992 00000100:00100000:3.0:1787893423.109274:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493476992 00000100:00100000:3.0:1787893423.109314:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787893423.109335:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+15:23496:x1874741493476992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893423.110044:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+15:23496:x1874741493476992:12345-0@lo:502:mount.lustre.0 Request processed in 721us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.110053:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787893423.110071:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493476992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893423.110286:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787893423.110306:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1787893423.110314:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1787893423.110341:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1787893423.110356:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1787893423.110369:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1787893423.110382:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1787893423.110394:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1787893423.110406:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1787893423.110418:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1787893423.110430:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1787893423.110441:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1787893423.110454:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1787893423.110467:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1787893423.110479:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1787893423.110585:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1787893423.110604:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1787893423.110617:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1787893423.110630:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1787893423.110641:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1787893423.110653:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1787893423.110666:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1787893423.110677:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1787893423.110690:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1787893423.110701:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1787893423.110713:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1787893423.110727:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1787893423.110752:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1787893423.110765:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1787893423.110876:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1787893423.110908:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1787893423.110921:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1787893423.110934:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1787893423.110946:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1787893423.110960:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1787893423.110975:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1787893423.110988:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1787893423.111001:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1787893423.111015:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1787893423.111027:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1787893423.111039:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1787893423.111051:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1787893423.111063:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1787893423.111074:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1787893423.111109:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493477120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893423.111167:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.111198:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893423.111206:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493477120 00000100:00100000:2.0:1787893423.111212:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493477120 00000100:00100000:2.0:1787893423.111273:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787893423.111282:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+15:23496:x1874741493477120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893423.111388:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+15:23496:x1874741493477120:12345-0@lo:502:mount.lustre.0 Request processed in 106us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.111395:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787893423.111410:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493477120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893423.111446:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1787893423.111454:0:23496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787893423.112435:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893423.112448:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.112451:0:23500:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787893423.112455:0:23500:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787893423.112459:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787893423.112472:0:23500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9fc9e73599b8) 00000020:00000080:1.0:1787893423.112552:0:23500:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787893423.112560:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787893423.112633:0:23500:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787893423.112641:0:23500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf26d9 00000020:00000080:1.0:1787893423.112975:0:23500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787893423.112985:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893423.112988:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.112990:0:23500:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787893423.112993:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893423.112997:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.112998:0:23500:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787893423.113001:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787893423.113010:0:23500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9fc9fe143370) 00000020:00000080:1.0:1787893423.113021:0:23500:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787893423.113027:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787893423.113029:0:23500:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787893423.113032:0:23500:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787893423.113037:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787893423.113085:0:23500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9ffc1a000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787893423.113098:0:23500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9fc9fe144d28) 00000020:00000080:1.0:1787893423.113107:0:23500:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787893423.113237:0:23500:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787893423.113243:0:23500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf26ee 00000020:00000080:1.0:1787893423.113345:0:23500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787893423.113352:0:23500:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787893423.113357:0:23500:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9232577658cf26f5 00080000:01000000:1.0:1787893423.113363:0:23500:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787893423.113366:0:23500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf26fc 00010000:00010000:3.0:1787893423.165759:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893423.196333:0:23500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1787893423.199005:0:23500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1787893423.199342:0:23500:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787893423.201568:0:23500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787893423.201582:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893423.201592:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893423.201594:0:23500:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787893423.201597:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893423.201602:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893423.201603:0:23500:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787893423.201614:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787893423.201619:0:23500:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:00000080:0.0:1787893423.201639:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787893423.201652:0:23500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9fc8c71d99b8) 00000020:00000080:0.0:1787893423.201670:0:23500:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1787893423.201673:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787893423.201729:0:23500:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787893423.201733:0:23500:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787893423.201738:0:23500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf270a 00010000:00080000:0.0:1787893423.201761:0:23500:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c855a000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787893423.203112:0:23500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787893423.207688:0:23500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787893423.207703:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787893423.207752:0:23500:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787893423.207773:0:23500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf2711 00000100:00080000:3.0:1787893423.208247:0:23500:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787893423.208254:0:23500:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc8c855a000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893423.208292:0:23500:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711c700 x1874741493477248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787893423.208328:0:23500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787893423.208381:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787893423.208384:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787893423.208387:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893423.208392:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:3.0:1787893423.208395:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787893423.208399:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc9c7e94000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893423.208411:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711df80 x1874741493477504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787893423.208421:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893423.208424:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893423.208433:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893423.208436:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787893423.208476:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afca6d2b-351c-4adb-95b2-d9dd13744042:3631:1874741493477376:0@lo:400:kworker.0 00000100:00100000:3.0:1787893423.208760:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893423.208986:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493477632:0@lo:400:kworker.0 00000100:00100000:3.0:1787893423.209016:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893423.209056:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493477632 00000100:00100000:3.0:1787893423.209063:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493477632 00000100:00100000:3.0:1787893423.209112:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893423.209122:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493477632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893423.209176:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493477632:12345-0@lo:400:kworker.0 Request processed in 55us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.209183:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787893423.209221:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc9e711c380 x1874741493477632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893423.209234:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493477632:0@lo:400:kworker.0 00000100:00100000:3.0:1787893423.209256:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493477376 00000100:00100000:3.0:1787893423.209260:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493477376 00000100:00100000:3.0:1787893423.209286:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787893423.209293:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+15:3631:x1874741493477376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893423.209338:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+15:3631:x1874741493477376:12345-0@lo:400:kworker.0 Request processed in 45us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.209343:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787893423.209377:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afca6d2b-351c-4adb-95b2-d9dd13744042:3631:1874741493477376:0@lo:400:kworker.0 00000020:01000000:3.0:1787893423.209456:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893423.209462:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893423.209464:0:23500:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787893423.209467:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787893423.209470:0:23500:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787893423.209471:0:23500:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893423.209473:0:23500:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893423.209475:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787893423.209477:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893423.209478:0:23500:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787893423.209481:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893423.209486:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893423.209487:0:23500:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787893423.209519:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787893423.209571:0:23500:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787893423.209586:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893423.209589:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893423.209590:0:23500:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787893423.209593:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787893423.209595:0:23500:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787893423.209596:0:23500:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893423.209597:0:23500:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893423.209599:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787893423.209601:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893423.209602:0:23500:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787893423.210106:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787893423.210110:0:23500:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787893423.210114:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893423.210116:0:23500:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787893423.210120:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787893423.210123:0:23500:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:3.0:1787893423.210144:0:23500:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787893423.210147:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787893423.210169:0:23500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9fc8c74c19b8) 00000100:00100000:2.0:1787893423.210533:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493477248:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787893423.210587:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893423.210635:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493477504:0@lo:38:kworker.0 00000100:00100000:2.0:1787893423.210658:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893423.210894:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493477248 00000100:00100000:0.0:1787893423.210901:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493477248 00000100:00100000:0.0:1787893423.210921:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493477504 00000100:00100000:0.0:1787893423.210923:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493477504 00000100:00100000:0.0:1787893423.210936:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787893423.210942:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493477248:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787893423.210968:0:22769:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:3.0:1787893423.211241:0:23500:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787893423.211253:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787893423.211346:0:23500:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787893423.211353:0:23500:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787893423.211360:0:23500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf2726 00010000:00080000:3.0:1787893423.211389:0:23500:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9c5fdd000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787893423.212108:0:23500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000020:00000080:0.0:1787893423.213426:0:22769:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf271f 00000004:00100000:0.0:1787893423.213589:0:22769:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787893423.213596:0:22769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:3.0:1787893423.214281:0:23500:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787893423.214553:0:23500:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787893423.219194:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893423.220419:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1787893423.220728:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787893423.221063:0:23505:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787893423.221068:0:23505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787893423.222048:0:23500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787893423.222060:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787893423.222097:0:23500:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787893423.222117:0:23500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf272d 00000100:00080000:3.0:1787893423.222126:0:23500:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787893423.222132:0:23500:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc9c5fdd000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893423.222165:0:23500:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711f100 x1874741493477760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893423.222232:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493477760:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787893423.222286:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493477760 offset 0 length 520: 4 00000100:00080000:3.0:1787893423.222360:0:23500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787893423.222416:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893423.222420:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893423.222421:0:23500:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787893423.222424:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787893423.222427:0:23500:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1787893423.222428:0:23500:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893423.222430:0:23500:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893423.222431:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787893423.222433:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893423.222440:0:23500:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787893423.222443:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787893423.222447:0:23500:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787893423.222451:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893423.222452:0:23500:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787893423.222455:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787893423.222458:0:23500:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.135@tcp to nid 0x20000c0a8ca87 (192.168.202.135@tcp) 00000020:01000000:3.0:1787893423.222478:0:23500:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787893423.222481:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787893423.222521:0:23500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9fc8c74c4d28) 00000020:00000080:3.0:1787893423.222534:0:23500:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1787893423.222539:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787893423.222626:0:23500:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787893423.222632:0:23500:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787893423.222638:0:23500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9232577658cf273b 00010000:00080000:3.0:1787893423.222667:0:23500:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c75fc000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:3.0:1787893423.222877:0:23500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787893423.222940:0:23500:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787893423.222954:0:23500:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1787893423.223266:0:22769:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787893423.223328:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893423.223333:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893423.223340:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893423.223343:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787893423.225097:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893423.225315:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1787893423.225428:0:23500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1787893423.226120:0:23507:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787893423.226124:0:23507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1787893423.226731:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3629:x1874741493477248:12345-0@lo:38:llog_process_th.0 Request processed in 15782us (16137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.226743:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787893423.226886:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787893423.226898:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787893423.226907:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787893423.226912:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787893423.226915:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c855a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787893423.226936:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493477248:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787893423.226979:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893423.226986:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493477504:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787893423.227061:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493477504:12345-0@lo:38:kworker.0 Request processed in 74us (16402us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787893423.227067:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:00000080:1.0:1787893423.227488:0:23500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787893423.227521:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787893423.227559:0:23500:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787893423.227580:0:23500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf2742 00000100:00080000:1.0:1787893423.227592:0:23500:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787893423.227597:0:23500:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc8c75fc000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893423.227890:0:23500:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fa52b800 x1874741493477888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893423.227907:0:23500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787893423.228014:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893423.228019:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.228021:0:23500:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787893423.228023:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893423.228027:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.228029:0:23500:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787893423.228032:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787893423.228033:0:23500:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787893423.228035:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893423.228038:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.228039:0:23500:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787893423.228042:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893423.228044:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.228045:0:23500:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787893423.228049:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787893423.228079:0:23500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893423.228082:0:23500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.228083:0:23500:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787893423.228086:0:23500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:1.0:1787893423.228143:0:23496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1787893423.228187:0:23496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787893423.228202:0:23496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf26c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf26cb expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.228212:0:23496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541e00/0x9232577658cf26c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf26cb expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893423.228232:0:23496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ffc1a000 from 1 10000000:01000000:1.0:1787893423.228235:0:23496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787893423.228259:0:23496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.228266:0:23496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.228276:0:23496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893423.228295:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893423.228383:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.228412:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1ea6e40 going to sleep for 11 seconds 00000100:00080000:3.0:1787893423.229561:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893423.229567:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893423.229571:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893423.229574:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787893423.230348:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493478016 00000100:00100000:2.0:1787893423.230359:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493478016 00000100:00100000:3.0:1787893423.230376:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493477888:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787893423.230415:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787893423.230424:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+15:23496:x1874741493478016:12345-0@lo:101:mount.lustre.0 00000400:00000100:3.0:1787893423.230426:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493477888 offset 0 length 520: 4 00010000:00010000:2.0:1787893423.230450:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893423.230465:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2749 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893423.230471:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787893423.230479:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893423.230482:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787893423.230486:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493477504:0@lo:38:kworker.0 00010000:00010000:2.0:1787893423.230508:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2749 expref: 16 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893423.230519:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2749 expref: 16 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893423.230529:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1c00, rc 0) 00000100:00100000:2.0:1787893423.230581:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+16:23496:x1874741493478016:12345-0@lo:101:mount.lustre.0 Request processed in 157us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.230603:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787893423.230627:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893423.230643:0:23496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.230653:0:23496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893423.231249:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478144:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787893423.231291:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.231315:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1ea6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.231925:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493478144 00000100:00100000:3.0:1787893423.231932:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493478144 00000100:00100000:3.0:1787893423.231975:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787893423.231984:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+16:23496:x1874741493478144:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787893423.232001:0:22755:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787893423.232019:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787893423.232022:0:22755:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787893423.232310:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+16:23496:x1874741493478144:12345-0@lo:256:mount.lustre.0 Request processed in 325us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.232338:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787893423.232415:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478144:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787893423.232697:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493478272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893423.232738:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893423.233545:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493478272 00000100:00100000:0.0:1787893423.233553:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493478272 00000100:00100000:0.0:1787893423.233600:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787893423.233608:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1874741493478272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893423.233638:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787893423.233694:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3633:x1874741493478272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893423.233701:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787893423.233755:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493478272:0@lo:41:osp-pre-0-1.0 10000000:01000000:1.0:1787893423.234015:0:23496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787893423.234048:0:23496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.234058:0:23496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893423.234067:0:23496:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9ffc1a000 from 1 10000000:01000000:1.0:1787893423.234070:0:23496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787893423.234095:0:23496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.234103:0:23496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.234111:0:23496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893423.234197:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893423.234302:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.234382:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1ea6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893423.234416:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493478400 00000100:00100000:2.0:1787893423.234422:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493478400 00000100:00100000:2.0:1787893423.234487:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787893423.234531:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+16:23496:x1874741493478400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893423.234540:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893423.234553:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e0e00/0x9232577658cf275e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2757 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893423.234574:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e0e00/0x9232577658cf275e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2757 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893423.234584:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c67e0e00/0x9232577658cf275e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2757 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893423.234592:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0e00, rc 0) 00000100:00100000:2.0:1787893423.234894:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+17:23496:x1874741493478400:12345-0@lo:101:mount.lustre.0 Request processed in 365us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.234900:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787893423.234966:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893423.234980:0:23496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.234989:0:23496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787893423.236259:0:23496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1787893423.236563:0:23496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787893423.236737:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787893423.236769:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1787893423.236898:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1787893423.236915:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1787893423.236930:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1787893423.236944:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1787893423.237170:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1787893423.237189:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1787893423.237203:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787893423.237216:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1787893423.237229:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1787893423.237245:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1787893423.237250:0:23496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1787893423.237339:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893423.237397:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.238350:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1ea6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.238421:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493478528 00000100:00100000:3.0:1787893423.238430:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493478528 00000100:00100000:3.0:1787893423.238473:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787893423.238483:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+17:23496:x1874741493478528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893423.238645:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+17:23496:x1874741493478528:12345-0@lo:501:mount.lustre.0 Request processed in 163us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.238653:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787893423.238908:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893423.238948:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893423.238994:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.239017:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1ea6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.239120:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493478656 00000100:00100000:3.0:1787893423.239125:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493478656 00000100:00100000:3.0:1787893423.239158:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787893423.239165:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+17:23496:x1874741493478656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893423.239415:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+17:23496:x1874741493478656:12345-0@lo:503:mount.lustre.0 Request processed in 250us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.239423:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787893423.239519:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478656:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787893423.240182:0:23496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787893423.240377:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893423.240423:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.240447:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1ea6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.240836:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493478784 00000100:00100000:3.0:1787893423.240843:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493478784 00000100:00100000:3.0:1787893423.240874:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787893423.240882:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+17:23496:x1874741493478784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893423.240982:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+17:23496:x1874741493478784:12345-0@lo:502:mount.lustre.0 Request processed in 100us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.240990:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787893423.241216:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893423.241484:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787893423.241541:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1787893423.241568:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1787893423.241582:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1787893423.241596:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1787893423.241938:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1787893423.241956:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1787893423.241970:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1787893423.241984:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787893423.241997:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1787893423.242014:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1787893423.242045:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893423.242093:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.242125:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1ea6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.242311:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493478912 00000100:00100000:3.0:1787893423.242316:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493478912 00000100:00100000:3.0:1787893423.242372:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787893423.242381:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+17:23496:x1874741493478912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893423.242459:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+17:23496:x1874741493478912:12345-0@lo:502:mount.lustre.0 Request processed in 79us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.242466:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787893423.243020:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493478912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893423.243075:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1787893423.243085:0:23496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787893423.245951:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893423.245968:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.245970:0:23509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787893423.245977:0:23509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9ffc1a000 00000020:00000080:1.0:1787893423.245980:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893423.245989:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893423.245991:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.245993:0:23509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787893423.245995:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893423.245997:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.245998:0:23509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787893423.246001:0:23509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9ffc1a000 00000020:00000080:1.0:1787893423.246003:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893423.246065:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893423.246069:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.246070:0:23509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787893423.246085:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893423.246088:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.246090:0:23509:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787893423.246093:0:23509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9ffc1a000 00000020:00000080:1.0:1787893423.246095:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893423.246142:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893423.246146:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.246148:0:23509:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787893423.246150:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893423.246153:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.246155:0:23509:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787893423.246157:0:23509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9ffc1a000 00000020:00000080:1.0:1787893423.246159:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787893423.246182:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893423.246185:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893423.246186:0:23509:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787893423.246189:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1787893423.246453:0:23496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787893423.246482:0:23496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787893423.246524:0:23496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893423.246536:0:23496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893423.246589:0:23496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787893423.246592:0:23496:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc9ffc1a000 10000000:01000000:0.0:1787893423.246595:0:23496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc9ffc1a000 10000000:01000000:0.0:1787893423.246599:0:23496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787893423.246615:0:23496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9ffc1a000 from 1 10000000:01000000:0.0:1787893423.246618:0:23496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787893423.246655:0:23496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30c00/0x9232577658cf2765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893423.246663:0:23496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30c00/0x9232577658cf2765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893423.246674:0:23496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30c00/0x9232577658cf2765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893423.246715:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787893423.246803:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893423.254958:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3869540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.255094:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493479040 00000100:00100000:3.0:1787893423.255105:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493479040 00000100:00100000:3.0:1787893423.255331:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787893423.256861:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+17:23496:x1874741493479040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893423.256888:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893423.256908:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7fc00/0x9232577658cf276c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2765 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.256939:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7fc00/0x9232577658cf276c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2765 expref: 18 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.256950:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c7c7fc00/0x9232577658cf276c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2765 expref: 18 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.256960:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7fc00, rc 0) 00000100:00100000:3.0:1787893423.257052:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479040:12345-0@lo:101:mount.lustre.0 Request processed in 278us (10249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.257059:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787893423.258015:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893423.258038:0:23496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30c00/0x9232577658cf2765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf276c expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893423.258049:0:23496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30c00/0x9232577658cf2765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf276c expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893423.273471:0:23496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1787893423.274024:0:23496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787893423.288538:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1787893423.288592:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1787893423.289052:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1787893423.289071:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1787893423.289089:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1787893423.289238:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1787893423.289264:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1787893423.289282:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1787893423.289311:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1787893423.289356:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1787893423.289376:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1787893423.289398:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1787893423.289419:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1787893423.289439:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1787893423.289454:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1787893423.289468:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1787893423.289482:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1787893423.289574:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1787893423.289591:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1787893423.289674:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1787893423.289694:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1787893423.289708:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1787893423.289723:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1787893423.289740:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1787893423.289754:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1787893423.289782:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1787893423.289805:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1787893423.289817:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1787893423.289828:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1787893423.289839:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1787893423.289850:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1787893423.289861:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1787893423.290009:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1787893423.290032:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1787893423.290050:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1787893423.290067:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1787893423.290087:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1787893423.290238:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1787893423.290261:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1787893423.290278:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1787893423.290299:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1787893423.290350:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1787893423.290371:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1787893423.290391:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1787893423.290409:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1787893423.290423:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1787893423.290438:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1787893423.290451:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1787893423.290737:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1787893423.290758:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1787893423.290775:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1787893423.290781:0:23496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1787893423.291424:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893423.291534:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.291588:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c395c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893423.291614:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493479168 00000100:00100000:2.0:1787893423.291623:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493479168 00000100:00100000:2.0:1787893423.291669:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787893423.291679:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893423.291836:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479168:12345-0@lo:501:mount.lustre.0 Request processed in 158us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.291845:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787893423.291863:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893423.291917:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893423.291958:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.291979:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c395c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893423.292387:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493479296 00000100:00100000:2.0:1787893423.292398:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493479296 00000100:00100000:2.0:1787893423.292442:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787893423.292449:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893423.292562:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479296:12345-0@lo:503:mount.lustre.0 Request processed in 113us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.292570:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787893423.292584:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479296:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787893423.293845:0:23496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787893423.294075:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893423.294291:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.294341:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1ea6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893423.295100:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493479424 00000100:00100000:2.0:1787893423.295110:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493479424 00000100:00100000:2.0:1787893423.295169:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787893423.295180:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893423.295315:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479424:12345-0@lo:502:mount.lustre.0 Request processed in 136us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.295334:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787893423.295366:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893423.295796:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1787893423.295829:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1787893423.295844:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1787893423.296022:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1787893423.296044:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1787893423.296063:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1787893423.296083:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1787893423.296116:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1787893423.296263:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1787893423.296281:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1787893423.296295:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1787893423.296308:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1787893423.296334:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1787893423.296351:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1787893423.296364:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1787893423.296379:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1787893423.296395:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1787893423.296411:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1787893423.296425:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1787893423.296452:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1787893423.296467:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1787893423.296479:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1787893423.296512:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1787893423.296530:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1787893423.296543:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1787893423.296556:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1787893423.296570:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1787893423.296584:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1787893423.296597:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1787893423.296685:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1787893423.296702:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1787893423.296715:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1787893423.296731:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1787893423.296810:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1787893423.296833:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1787893423.296845:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1787893423.296856:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1787893423.296867:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1787893423.296880:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1787893423.296891:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1787893423.296903:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1787893423.296925:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1787893423.296940:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1787893423.296953:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1787893423.296967:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1787893423.296981:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1787893423.297009:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1787893423.297024:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1787893423.297074:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893423.297134:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893423.297178:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c72b2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787893423.297213:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493479552 00000100:00100000:1.0:1787893423.297221:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493479552 00000100:00100000:1.0:1787893423.297266:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787893423.297282:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893423.297413:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479552:12345-0@lo:502:mount.lustre.0 Request processed in 132us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893423.297422:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787893423.297943:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787893423.298146:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1787893423.298169:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1787893423.298194:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893423.298242:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893423.298278:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c72b2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893423.298335:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493479680 00000100:00100000:2.0:1787893423.298340:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493479680 00000100:00100000:2.0:1787893423.298378:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787893423.298386:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893423.298553:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479680:12345-0@lo:502:mount.lustre.0 Request processed in 167us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.298561:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787893423.302579:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787893423.302684:0:23496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1787893423.302697:0:23496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787893423.309051:0:23515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787893423.309070:0:23515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9fc9ed578000) 00000020:00000080:2.0:1787893423.309092:0:23515:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787893423.309179:0:23515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9ffc1a000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787893423.309183:0:23515:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9ffc1a000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787893423.309186:0:23515:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9ffc1a000 3 00010000:00080000:2.0:1787893423.309226:0:23515:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc9e5aec000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787893423.314921:0:23515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787893423.315152:0:23515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787893423.315197:0:23515:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787893423.315212:0:23515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9232577658cf277a 00000100:00080000:2.0:1787893423.315223:0:23515:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893423.315228:0:23515:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fc9e5aec000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893423.315265:0:23515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9c3e6df80 x1874741493479808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893423.315313:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493479808:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787893423.315400:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893423.318049:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493479808 00000100:00100000:2.0:1787893423.318066:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493479808 00000100:00100000:2.0:1787893423.318122:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787893423.318131:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493479808:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787893423.318163:0:22763:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1787893423.318220:0:22763:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9232577658cf2781 00000004:00100000:2.0:1787893423.318240:0:22763:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787893423.318273:0:22763:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5aeb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893423.318370:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1874741493479808:12345-0@lo:38:llog_process_th.0 Request processed in 238us (2969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.318378:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787893423.318422:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc9c3e6df80 x1874741493479808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893423.318445:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787893423.318453:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787893423.318461:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787893423.318467:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787893423.318479:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9e5aec000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787893423.318485:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3629:1874741493479808:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787893423.318647:0:23515:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787893423.318894:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893423.318899:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893423.318901:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893423.318904:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787893423.321061:0:23515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1787893423.323957:0:23496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787893423.324026:0:23496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787893423.324061:0:23496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30c00/0x9232577658cf2765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf276c expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893423.324075:0:23496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30c00/0x9232577658cf2765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf276c expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787893423.324142:0:23496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787893423.324144:0:23496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787893423.324146:0:23496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893423.324147:0:23496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893423.324148:0:23496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893423.324149:0:23496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893423.324151:0:23496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787893423.324153:0:23496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893423.324154:0:23496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787893423.324158:0:23496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1787893423.324160:0:23496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787893423.324161:0:23496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787893423.324167:0:23496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893423.324168:0:23496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893423.324169:0:23496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893423.324170:0:23496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893423.324171:0:23496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787893423.324171:0:23496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893423.324172:0:23496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787893423.324200:0:23496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787893423.324223:0:23496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479936:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787893423.324291:0:23496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893423.324335:0:23496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c72b2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893423.324733:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493479936 00000100:00100000:2.0:1787893423.324741:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493479936 00000100:00100000:2.0:1787893423.324797:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787893423.324807:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479936:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787893423.324834:0:22757:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787893423.324847:0:22757:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787893423.332121:0:22743:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787893423.332160:0:22757:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787893423.332178:0:22757:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787893423.332623:0:22779:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787893423.332630:0:22779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787893423.332656:0:22779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893423.332676:0:22779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf268c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2685 expref: 18 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893423.332684:0:22779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2749 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893423.332691:0:22779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893423.332747:0:22779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf2749 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893423.332764:0:22779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf2749 expref: 18 pid: 22757 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893423.332786:0:22779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493480064:0@lo:104: 00000100:00100000:0.0:1787893423.332853:0:22779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787893423.332916:0:22779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf268c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf2685 expref: 18 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893423.332926:0:22779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf268c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf2685 expref: 18 pid: 22755 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893423.332935:0:22779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493480192:0@lo:104: 00000100:00100000:0.0:1787893423.332956:0:22779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893423.332971:0:22779:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c72b2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893423.333283:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:23496:x1874741493479936:12345-0@lo:253:mount.lustre.0 Request processed in 8475us (8989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893423.333294:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787893423.334021:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493480064 00000100:00100000:3.0:1787893423.334030:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493480064 00000100:00100000:3.0:1787893423.334062:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493480192 00000100:00100000:3.0:1787893423.334071:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493480192 00000100:00100000:3.0:1787893423.334088:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893423.334096:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+4:22779:x1874741493480064:12345-0@lo:104: 00010000:00010000:3.0:1787893423.334110:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.334167:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787893423.334173:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+4:22779:x1874741493480064:12345-0@lo:104: Request processed in 79us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.334179:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893423.334191:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787893423.334197:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+3:22779:x1874741493480192:12345-0@lo:104: 00010000:00010000:3.0:1787893423.334204:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.334233:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787893423.334238:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+3:22779:x1874741493480192:12345-0@lo:104: Request processed in 42us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.334244:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787893423.334263:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787893423.334269:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.334276:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893423.334281:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.334288:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893423.334305:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893423.334311:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1787893423.334992:0:23496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:23496:1874741493479936:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787893423.335007:0:23496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787893423.335010:0:23496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787893423.335011:0:23496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787893423.335013:0:23496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893423.335014:0:23496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893423.335015:0:23496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893423.335017:0:23496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893423.335018:0:23496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787893423.335020:0:23496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893423.335021:0:23496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787893423.335036:0:23496:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787893423.335883:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.335894:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893423.335915:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.335924:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540e00/0x9232577658cf2749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf2750 expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.335939:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893423.335942:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.335949:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893423.335953:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.335962:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893423.335970:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893423.335975:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787893423.335998:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.336005:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893423.336011:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.336017:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540a00/0x9232577658cf2685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf268c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.336030:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893423.336032:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893423.336034:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893423.336041:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893423.336062:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493480320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893423.336115:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893423.336156:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893423.336163:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493480448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893423.336183:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893423.336214:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493480320 00000100:00100000:3.0:1787893423.336220:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493480320 00010000:00010000:3.0:1787893423.336243:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2750 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2749 expref: 18 pid: 22757 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893423.336265:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493480448 00000100:00100000:3.0:1787893423.336267:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493480448 00010000:00010000:3.0:1787893423.336277:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf268c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2685 expref: 19 pid: 22755 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893423.336290:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893423.336297:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+19:3630:x1874741493480320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893423.336314:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893423.338270:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2750 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2749 expref: 19 pid: 22757 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338286:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf2749 expref: 19 pid: 22757 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338306:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893423.338644:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+19:3630:x1874741493480320:12345-0@lo:103:ldlm_bl.0 Request processed in 2345us (2526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.338653:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893423.338680:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787893423.338689:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+18:3630:x1874741493480448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893423.338704:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893423.338718:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf268c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2685 expref: 18 pid: 22755 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338728:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf268c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf2685 expref: 18 pid: 22755 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338740:0:22748:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338748:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787893423.338762:0:22748:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017661601s 00010000:00010000:3.0:1787893423.338767:0:22748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338790:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338798:0:22748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338805:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338811:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893423.338815:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338822:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338831:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338841:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893423.338862:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+18:3630:x1874741493480448:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (2678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.338867:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787893423.338911:0:22779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf2749 expref: 17 pid: 22757 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893423.338922:0:22779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493480064:0@lo:104: 00010000:00010000:3.0:1787893423.338932:0:22779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf268c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf2685 expref: 16 pid: 22755 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893423.338951:0:22779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493480192:0@lo:104: 00010000:00010000:3.0:1787893423.338970:0:22779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338978:0:22779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338985:0:22779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893423.338991:0:22779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30e00/0x9232577658cf2788 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893423.342082:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493480320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893423.342112:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493480448:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1787893423.344151:0:23496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1787893423.344467:0:23521:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787893423.345148:0:23496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1787893423.346119:0:23521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787893423.349086:0:23522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23522:1874741493480576:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787893423.349163:0:23522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893423.349200:0:23522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c690a9c0 going to sleep for 11 seconds 00000040:00080000:1.0:1787893423.350657:0:23521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787893423.350773:0:23521:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1787893423.351219:0:23496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787893423.351260:0:23496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787893423.351969:0:23496:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787893423.351979:0:23496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787893423.352033:0:23496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787893423.353651:0:23520:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787893423.353660:0:23520:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787893423.353687:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493480576 00000100:00100000:3.0:1787893423.353697:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493480576 00000100:00100000:3.0:1787893423.353767:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893423.353963:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23522:x1874741493480576:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787893423.354099:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23522:x1874741493480576:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 323us (4937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.354107:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:00080000:0.0:1787893423.356190:0:23496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1787893423.358017:0:23522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23522:1874741493480576:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787893423.358068:0:23522:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787893423.358127:0:23522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23522:1874741493480704:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787893423.358196:0:23522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.358239:0:23522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c65ac300 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.358303:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493480704 00000100:00100000:3.0:1787893423.358310:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493480704 00000100:00100000:3.0:1787893423.358378:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787893423.358388:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23522:x1874741493480704:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787893423.358566:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23522:x1874741493480704:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 179us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.358587:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:0.0:1787893423.359205:0:23496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787893423.359278:0:23496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787893423.359413:0:23496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787893423.360063:0:23522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23522:1874741493480704:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787893423.360198:0:23522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23522:1874741493480832:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787893423.360251:0:23522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.360283:0:23522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c65aca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.360379:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493480832 00000100:00100000:3.0:1787893423.360385:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493480832 00000100:00100000:3.0:1787893423.360429:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893423.360449:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23522:x1874741493480832:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787893423.360525:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23522:x1874741493480832:12345-0@lo:900:lod0001_rec0000.0 Request processed in 77us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.360531:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787893423.360731:0:23522:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc9fa529180 x1874741493480832/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787893439 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893423.360742:0:23522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23522:1874741493480832:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787893423.360795:0:23522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23522:1874741493480960:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787893423.360821:0:23522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893423.360843:0:23522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c65ac300 going to sleep for 11 seconds 00000100:00100000:3.0:1787893423.360934:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493480960 00000100:00100000:3.0:1787893423.360939:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493480960 00000100:00100000:3.0:1787893423.360964:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787893423.360969:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23522:x1874741493480960:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787893423.361056:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23522:x1874741493480960:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893423.361062:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787893423.361383:0:23522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23522:1874741493480960:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787893423.361442:0:23522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787893423.364241:0:23496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:1.0:1787893423.368549:0:23522:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787893423.368648:0:23522:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787893423.368653:0:23522:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1787893423.371110:0:23496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1787893423.377278:0:23496:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787893423.377331:0:23496:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbaa0c1473988 00100000:10000000:2.0:1787893423.377340:0:23496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787893423.378382:0:23496:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787893423.378408:0:23496:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787893423.378424:0:23496:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787893423.378448:0:23496:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787893423.384205:0:23496:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787893423.384458:0:23496:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787893423.745689:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:3.0:1787893424.182054:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787893424.373443:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787893424.373967:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787893424.373972:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ffc1a000 from 12 10000000:01000000:2.0:1787893424.373975:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787893424.374021:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893424.374032:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893424.374052:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893424.374076:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493481088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893424.374142:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893424.374191:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787893424.375911:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493481088 00000100:00100000:3.0:1787893424.375925:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493481088 00000100:00100000:3.0:1787893424.375986:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787893424.375996:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+16:22761:x1874741493481088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893424.376013:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893424.376029:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf2796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf278f expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893424.376065:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf2796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf278f expref: 17 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893424.376076:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf2796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf278f expref: 17 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893424.376085:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e000, rc 0) 00000100:00100000:3.0:1787893424.376147:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+17:22761:x1874741493481088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893424.376154:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787893424.376429:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493481088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893424.376449:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893424.376458:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893424.376533:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493481216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787893424.376575:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893424.376621:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787893424.376672:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493481216 00000100:00100000:3.0:1787893424.376677:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493481216 00000100:00100000:3.0:1787893424.376715:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787893424.376723:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+17:22761:x1874741493481216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787893424.376736:0:22757:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787893424.376753:0:22757:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787893424.376756:0:22757:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1787893424.376830:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+17:22761:x1874741493481216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893424.376837:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787893424.376904:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493481216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787893424.376961:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787893424.376969:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893424.376977:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893424.376989:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787893424.376991:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9c425c800 from 12 10000000:01000000:2.0:1787893424.376999:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787893424.377017:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893424.377025:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893424.377033:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893424.377045:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493481344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893424.377070:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893424.377094:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787893424.377180:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493481344 00000100:00100000:3.0:1787893424.377186:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493481344 00000100:00100000:3.0:1787893424.377224:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787893424.377231:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+17:22761:x1874741493481344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893424.377238:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893424.377247:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf27a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf279d expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893424.377272:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf27a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf279d expref: 18 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893424.377281:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf27a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf279d expref: 18 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893424.377288:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7ec00, rc 0) 00000100:00100000:3.0:1787893424.377325:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+18:22761:x1874741493481344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893424.377331:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787893424.378061:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493481344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893424.378077:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893424.378087:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893424.378136:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493481472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787893424.378173:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893424.378192:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787893424.378283:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493481472 00000100:00100000:2.0:1787893424.378289:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493481472 00000100:00100000:2.0:1787893424.378333:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787893424.378340:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+18:22761:x1874741493481472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787893424.378353:0:22755:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787893424.378370:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787893424.378373:0:22755:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1787893424.378445:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+18:22761:x1874741493481472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893424.378452:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787893424.378505:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493481472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787893424.378541:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787893424.378547:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893424.378555:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893424.753674:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:3.0:1787893425.202160:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787893425.396623:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787893425.777861:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:3.0:1787893426.231093:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893426.802159:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00010000:00010000:3.0:1787893427.260520:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893427.829431:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 0 seconds 00000001:02000400:2.0:1787893428.138005:0:23765:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787893428.274716:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787893428.402927:0:22171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787893428.402934:0:22171:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787893428.402937:0:22171:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893428.402950:0:22171:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc9c7e94000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893428.402970:0:22171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8480a80 x1874741493481728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787893428.402986:0:22171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893428.402989:0:22171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893428.402992:0:22171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893428.402995:0:22171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893428.403012:0:22171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893428.403015:0:22171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893428.403018:0:22171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893428.403021:0:22171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787893428.403059:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493481600:0@lo:400:kworker.0 00000100:00100000:0.0:1787893428.403128:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893428.403169:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893428.403174:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493481856:0@lo:400:kworker.0 00000100:00100000:0.0:1787893428.403199:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893428.403225:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493481728:0@lo:38:kworker.0 00000100:00100000:0.0:1787893428.403248:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893428.403288:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493481984:0@lo:400:kworker.0 00000100:00100000:0.0:1787893428.403310:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893428.403325:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893428.403329:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493482112:0@lo:400:kworker.0 00000100:00100000:0.0:1787893428.403350:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893428.403376:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493481600 00000100:00100000:0.0:1787893428.403382:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493481600 00000100:00100000:0.0:1787893428.403432:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787893428.403440:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:3632:x1874741493481600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893428.403478:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:3632:x1874741493481600:12345-0@lo:400:kworker.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893428.403485:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787893428.403530:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493481856 00000100:00100000:0.0:1787893428.403533:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493481856 00000100:00100000:0.0:1787893428.403553:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493482112 00000100:00100000:0.0:1787893428.403555:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493482112 00000100:00100000:0.0:1787893428.403565:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893428.403570:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493481856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893428.403595:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493481856:12345-0@lo:400:kworker.0 Request processed in 25us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893428.403601:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893428.403624:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893428.403629:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493482112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893428.403654:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493482112:12345-0@lo:400:kworker.0 Request processed in 24us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893428.403659:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893428.403673:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493481728 00000100:00100000:0.0:1787893428.403676:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493481728 00000100:00100000:0.0:1787893428.403684:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493481984 00000100:00100000:0.0:1787893428.403686:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493481984 00000100:00100000:0.0:1787893428.403697:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787893428.403701:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3629:x1874741493481728:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787893428.403721:0:22769:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:0.0:1787893428.403749:0:22769:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf27ab 00000004:00100000:0.0:1787893428.403762:0:22769:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787893428.403767:0:22769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:0.0:1787893428.403850:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c8481180 x1874741493482112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893428.403863:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493482112:0@lo:400:kworker.0 00010000:00080000:0.0:1787893428.403883:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c8480e00 x1874741493481856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893428.403892:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493481856:0@lo:400:kworker.0 00000100:00100000:0.0:1787893428.403899:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493481600:0@lo:400:kworker.0 00000100:00100000:1.0:1787893428.408964:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893428.408982:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493482240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893428.409035:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893428.409077:0:22768:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787893428.409085:0:22768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1787893428.409204:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493482240 00000100:00100000:1.0:1787893428.409212:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493482240 00000100:00100000:1.0:1787893428.409316:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893428.409325:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3630:x1874741493481984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893428.409381:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3630:x1874741493481984:12345-0@lo:400:kworker.0 Request processed in 57us (6069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893428.409795:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893428.409898:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493481984:0@lo:400:kworker.0 00000100:00100000:1.0:1787893428.409924:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787893428.409932:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493482240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893428.409954:0:23786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787893428.410029:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493482240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893428.410036:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787893428.410089:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493482240:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787893428.417071:0:22769:0:(import.c:65:import_set_state_nolock()) ffff9fc9e78d3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893428.417173:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1874741493481728:12345-0@lo:38:kworker.0 Request processed in 13468us (13921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893428.417191:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787893428.417283:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787893428.417293:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787893428.417297:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787893428.417300:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e94000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787893428.417318:0:3629:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000f7e9f44): req@ffff9fc9e711c000 x1874741493474688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893428.417337:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493481728:0@lo:38:kworker.0 00000100:00100000:3.0:1787893428.417403:0:22805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893428.417425:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5f7e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893428.417439:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493474688 00000100:00100000:3.0:1787893428.417445:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493474688 00000100:00100000:3.0:1787893428.417478:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787893428.417514:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22805:x1874741493474688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893428.417579:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22805:x1874741493474688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893428.417585:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787893428.417609:0:22805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22805:1874741493474688:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787893428.417638:0:22805:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787893428.417674:0:22805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22805:1874741493482368:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893428.417704:0:22805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893428.417719:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893428.417729:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493482368 00000100:00100000:3.0:1787893428.417732:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493482368 00000100:00100000:3.0:1787893428.417753:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787893428.417758:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22805:x1874741493482368:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893428.417919:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22805:x1874741493482368:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 160us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893428.417925:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787893428.417949:0:22805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22805:1874741493482368:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893428.418002:0:22805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22805:1874741493482496:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893428.418023:0:22805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893428.418036:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d0c4b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893428.418047:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493482496 00000100:00100000:3.0:1787893428.418049:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493482496 00000100:00100000:3.0:1787893428.418069:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787893428.418075:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22805:x1874741493482496:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787893428.418117:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22805:x1874741493482496:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 41us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893428.418129:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787893428.418154:0:22805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22805:1874741493482496:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787893428.418254:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893428.418264:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493482624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893428.418297:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787893428.418429:0:22805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787893428.418717:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493482624 00000100:00100000:1.0:1787893428.418722:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493482624 00000100:00100000:1.0:1787893428.418747:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787893428.418755:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493482624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893428.418774:0:23786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787893428.418815:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493482624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893428.418941:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787893428.418971:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493482624:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787893428.421297:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787893428.421382:0:22805:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1787893428.421387:0:22805:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1787893428.983432:0:23818:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787893428.984323:0:23818:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787893429.297603:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787893430.008119:0:23868:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787893430.009699:0:23868:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787893430.322120:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787893431.088356:0:23917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd32a0eee0 20000000:00000080:0.0:1787893431.088373:0:23917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc9e7899000 uarg=0000000000000000 20000000:01000000:0.0:1787893431.088422:0:23917:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787893431.088429:0:23917:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787893431.088434:0:23917:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787893431.089028:0:23918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1787893431.089395:0:23917:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787893431.098065:0:23917:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787893431.098384:0:23917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893431.098405:0:23917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf265b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2654 expref: 17 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893431.098412:0:23917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c67e0e00/0x9232577658cf275e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2757 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893431.098420:0:23917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893431.098464:0:23917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c67e0e00/0x9232577658cf275e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf2757 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893431.098478:0:23917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c67e0e00/0x9232577658cf275e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf2757 expref: 17 pid: 22758 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893431.101804:0:23917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23917:1874741493482752:0@lo:104: 00000100:00100000:1.0:1787893431.101879:0:23917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893431.102317:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493482752 00000100:00100000:2.0:1787893431.102326:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493482752 00000100:00100000:2.0:1787893431.102380:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787893431.102390:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+3:23917:x1874741493482752:12345-0@lo:104: 00010000:00010000:2.0:1787893431.102407:0:22746:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893431.102465:0:22746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787893431.102470:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+3:23917:x1874741493482752:12345-0@lo:104: Request processed in 83us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893431.102487:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787893431.102530:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893431.102537:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893431.102545:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893431.102549:0:22752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893431.102558:0:22752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893431.102565:0:22752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893431.102571:0:22752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787893431.102604:0:22752:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893431.102610:0:22752:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893431.102629:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893431.102635:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540200/0x9232577658cf2757 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf275e expref: -99 pid: 23496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893431.102645:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893431.102647:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893431.102649:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893431.102668:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493482880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893431.103355:0:23917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf265b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf2654 expref: 17 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893431.103369:0:23917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf265b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf2654 expref: 17 pid: 22755 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893431.103381:0:23917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23917:1874741493483008:0@lo:104: 00000100:00100000:1.0:1787893431.103413:0:23917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893431.103447:0:23917:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd043240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893431.103467:0:23917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23917:1874741493482752:0@lo:104: 00000100:00100000:3.0:1787893431.103764:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493483008 00000100:00100000:3.0:1787893431.103770:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493483008 00000100:00100000:3.0:1787893431.103815:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787893431.103822:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+3:23917:x1874741493483008:12345-0@lo:104: 00010000:00010000:3.0:1787893431.103832:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.103885:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787893431.103891:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+3:23917:x1874741493483008:12345-0@lo:104: Request processed in 69us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893431.103897:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787893431.104213:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893431.104220:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893431.104228:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb30600 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787893431.104233:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893431.104346:0:23917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23917:1874741493483008:0@lo:104: 00010000:00010000:1.0:1787893431.104367:0:23917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893431.104435:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787893431.104569:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893431.104576:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893431.104581:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787893431.104617:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893431.104637:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893431.104653:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893431.104659:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30600/0x9232577658cf2654 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf265b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893431.104676:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893431.104678:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893431.104679:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893431.104787:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afca6d2b-351c-4adb-95b2-d9dd13744042:3631:1874741493483136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893431.104822:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893431.105030:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493482880 00000100:00100000:3.0:1787893431.105038:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493482880 00010000:00010000:3.0:1787893431.105063:0:22749:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c67e0e00/0x9232577658cf275e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2757 expref: 18 pid: 22758 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893431.105092:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493483136 00000100:00100000:3.0:1787893431.105096:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493483136 00010000:00010000:3.0:1787893431.105106:0:22749:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf265b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2654 expref: 19 pid: 22755 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893431.105611:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787893431.105622:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+19:3630:x1874741493482880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893431.105634:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893431.105641:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c67e0e00/0x9232577658cf275e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2757 expref: 19 pid: 22758 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893431.105652:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c67e0e00/0x9232577658cf275e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf2757 expref: 19 pid: 22758 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893431.105666:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c67e0e00/0x9232577658cf275e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf2757 expref: 19 pid: 22758 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893431.105681:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893431.105827:0:22750:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787893431.105837:0:22750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787893431.106062:0:22749:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787893431.106072:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787893431.106080:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:3631:x1874741493483136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893431.106089:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893431.106094:0:22749:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf265b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2654 expref: 18 pid: 22755 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.106104:0:22749:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf265b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf2654 expref: 18 pid: 22755 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.106113:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf265b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf2654 expref: 18 pid: 22755 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.106124:0:22749:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893431.106459:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+17:3630:x1874741493482880:12345-0@lo:103:ldlm_bl.0 Request processed in 837us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893431.106467:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787893431.106552:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.106569:0:22749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.106576:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.106582:0:22749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.106588:0:22749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.106602:0:22749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893431.106608:0:22749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.106618:0:22749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.106638:0:22749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893431.106649:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893431.106685:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+16:3631:x1874741493483136:12345-0@lo:103:ldlm_bl.0 Request processed in 606us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893431.106692:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787893431.106740:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afca6d2b-351c-4adb-95b2-d9dd13744042:3631:1874741493483136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893431.106822:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493482880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893431.106872:0:23917:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893431.106880:0:23917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893431.106886:0:23917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe540a00/0x9232577658cf27b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893431.345874:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787893431.798235:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787893432.374971:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787893432.819844:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787893432.819852:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9ffc1a000 from 13 10000000:01000000:3.0:1787893432.819858:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787893432.819904:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893432.819914:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893432.819925:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893432.819950:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787893432.820034:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893432.820077:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5c240 going to sleep for 11 seconds 00000100:00100000:2.0:1787893432.820133:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493483264 00000100:00100000:2.0:1787893432.820141:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493483264 00000100:00100000:2.0:1787893432.820228:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787893432.820248:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+16:22761:x1874741493483264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893432.820260:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893432.820274:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e0a00/0x9232577658cf27c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf27b9 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893432.820295:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e0a00/0x9232577658cf27c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf27b9 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893432.820305:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c67e0a00/0x9232577658cf27c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf27b9 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893432.820313:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0a00, rc 0) 00000100:00100000:2.0:1787893432.820361:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+17:22761:x1874741493483264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893432.820367:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787893432.820436:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893432.820450:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893432.820458:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893432.820584:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893432.820608:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893432.821558:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5c240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893432.821847:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493483392 00000100:00100000:1.0:1787893432.821854:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493483392 00000100:00100000:1.0:1787893432.821896:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787893432.821906:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+17:22761:x1874741493483392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893432.822054:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+17:22761:x1874741493483392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893432.822061:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787893432.825118:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893432.825179:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893432.825260:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893432.825302:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5c240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893432.825469:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493483520 00000100:00100000:1.0:1787893432.825475:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493483520 00000100:00100000:1.0:1787893432.825544:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787893432.825553:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+17:22761:x1874741493483520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893432.825675:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+17:22761:x1874741493483520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893432.825682:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787893432.825875:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787893432.827712:0:23994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787893432.827793:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787893432.827827:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787893432.827838:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893432.827849:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893432.827860:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787893432.827863:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9c425c800 from 13 10000000:01000000:1.0:1787893432.827866:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787893432.827898:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893432.827906:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893432.827916:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893432.827936:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787893432.827995:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893432.828030:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd043000 going to sleep for 11 seconds 00000100:00100000:1.0:1787893432.828048:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493483648 00000100:00100000:1.0:1787893432.828053:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493483648 00000100:00100000:1.0:1787893432.828083:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787893432.828091:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+17:22761:x1874741493483648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893432.828103:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893432.828114:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541600/0x9232577658cf27ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf27c7 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893432.828146:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541600/0x9232577658cf27ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf27c7 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893432.828157:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541600/0x9232577658cf27ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf27c7 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893432.828165:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541600, rc 0) 00000100:00100000:1.0:1787893432.828200:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:22761:x1874741493483648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893432.828207:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787893432.828261:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893432.828273:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893432.828282:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893432.828330:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893432.828356:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893432.828370:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd043000 going to sleep for 11 seconds 00000100:00100000:1.0:1787893432.828380:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493483776 00000100:00100000:1.0:1787893432.828383:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493483776 00000100:00100000:1.0:1787893432.828399:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787893432.828404:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:22761:x1874741493483776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893432.828522:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:22761:x1874741493483776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893432.828539:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787893432.828569:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893432.828591:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893432.828626:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893432.828638:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd043000 going to sleep for 11 seconds 00000100:00100000:1.0:1787893432.828648:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493483904 00000100:00100000:1.0:1787893432.828651:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493483904 00000100:00100000:1.0:1787893432.828666:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787893432.828671:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:22761:x1874741493483904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893432.828738:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:22761:x1874741493483904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893432.828744:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787893432.828781:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493483904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787893432.834830:0:23996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787893432.842172:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787893432.842210:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787893432.842221:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893432.842242:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893433.393632:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893433.522053:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893433.522075:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493484032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893433.522141:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893433.522173:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493484032 00000100:00100000:1.0:1787893433.522180:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493484032 00000100:00100000:1.0:1787893433.522223:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893433.522246:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493484032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893433.522277:0:23786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787893433.522320:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493484032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893433.522326:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787893433.522361:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493484032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893433.523689:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493484160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893433.523737:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893433.523778:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493484160 00000100:00100000:2.0:1787893433.523785:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493484160 00000100:00100000:2.0:1787893433.523822:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787893433.523830:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493484160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893433.523858:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787893433.523901:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1874741493484160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893433.523907:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787893433.523945:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493484160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893433.537154:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893423/real 1787893423] req@ffff9fc9fa52b800 x1874741493477888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893433 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893433.537199:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9fa52b800 x1874741493477888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893433 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893433.537210:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893423/real 1787893423] req@ffff9fc9e711f100 x1874741493477760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893433 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893433.537221:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9e711f100 x1874741493477760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893433 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893433.537248:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893433.544343:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893433.544351:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893433.544354:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893433.544357:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893433.544369:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893433.544372:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893433.544381:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893433.544384:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787893433.544388:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893433.544396:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 667 00000100:00080000:3.0:1787893433.544401:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787893433.544408:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc8c75fc000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893433.544433:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711c700 x1874741493484544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893433.544665:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493484672:0@lo:400:kworker.0 00000100:00100000:2.0:1787893433.544731:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893433.544783:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493484672 00000100:00100000:2.0:1787893433.544791:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493484672 00000100:00100000:2.0:1787893433.544835:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893433.544843:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493484672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893433.544891:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493484672:12345-0@lo:400:kworker.0 Request processed in 47us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893433.544897:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787893433.544932:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc9e711e300 x1874741493484672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893433.544958:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493484672:0@lo:400:kworker.0 00000100:00080000:1.0:1787893433.546310:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787893433.546318:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493477888:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787893433.546328:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5fdd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893433.546333:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787893433.546336:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493477760:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787893433.548877:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493484544:0@lo:8:kworker.0 00000400:00000100:1.0:1787893433.548965:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493484544 offset 0 length 520: 4 00000100:00080000:1.0:1787893433.549026:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893433.549030:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893433.549034:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893433.549036:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893433.549040:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893433.549043:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787893433.549047:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5fdd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893433.549064:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 667 00000100:00080000:1.0:1787893433.549068:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787893433.549074:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc9c5fdd000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893433.549101:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fa52b800 x1874741493484800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893433.549136:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493484800:0@lo:8:kworker.0 00000400:00000100:1.0:1787893433.549156:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493484800 offset 0 length 520: 4 00000100:00100000:3.0:1787893433.555679:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493484288:0@lo:400:kworker.0 00000100:00100000:3.0:1787893433.555755:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893433.555802:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893433.555808:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493484416:0@lo:400:kworker.0 00000100:00100000:3.0:1787893433.555831:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893433.555874:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493484416 00000100:00100000:3.0:1787893433.555881:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493484416 00000100:00100000:3.0:1787893433.555923:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893433.555930:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493484416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893433.555977:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493484416:12345-0@lo:400:kworker.0 Request processed in 47us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893433.555983:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787893433.556017:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc9e711c380 x1874741493484416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893433.556029:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493484416:0@lo:400:kworker.0 00000100:00100000:1.0:1787893433.556947:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493484288 00000100:00100000:1.0:1787893433.556956:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493484288 00000100:00100000:1.0:1787893433.557010:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787893433.557020:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:3630:x1874741493484288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893433.557075:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:3630:x1874741493484288:12345-0@lo:400:kworker.0 Request processed in 57us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893433.557082:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787893433.557256:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493484288:0@lo:400:kworker.0 00000001:00100000:2.0:1787893434.036111:0:23497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787893434.417683:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893434.612780:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893419/real 1787893419] req@ffff9fc9e711d180 x1874741493475712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893434 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893434.612818:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9e711d180 x1874741493475712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893434 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893434.612828:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893419/real 1787893419] req@ffff9fc9e711f480 x1874741493475840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893434 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893434.612840:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9e711f480 x1874741493475840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893434 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787893434.612858:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb46800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893434.612935:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893434.612940:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493475712:0@lo:8:kworker.0 00000100:00080000:0.0:1787893434.612947:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7747000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893434.613345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893434.613350:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787893434.613358:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb46800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893434.613363:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:3.0:1787893434.613368:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787893434.613375:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc9ffb46800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893434.613395:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9e711c000 x1874741493485184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787893434.613406:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893434.613408:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787893434.613410:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7747000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787893434.613412:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:3.0:1787893434.613414:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787893434.613418:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc8c7747000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:3.0:1787893434.613428:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7525f80 x1874741493485312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787893434.613446:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893434.613449:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893434.613452:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893434.613455:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787893434.613478:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493485568:0@lo:400:kworker.0 00000100:00100000:3.0:1787893434.613563:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893434.613598:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787893434.613604:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493484928:0@lo:400:kworker.0 00000100:00100000:3.0:1787893434.613629:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893434.613652:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493485696:0@lo:400:kworker.0 00000100:00100000:3.0:1787893434.613701:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893434.613728:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493485056:0@lo:400:kworker.0 00000100:00100000:3.0:1787893434.613751:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893434.613769:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893434.613774:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493485440:0@lo:400:kworker.0 00000100:00100000:3.0:1787893434.613794:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893434.613822:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493485568 00000100:00100000:3.0:1787893434.613829:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493485568 00000100:00100000:3.0:1787893434.613867:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493485056 00000100:00100000:3.0:1787893434.613871:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493485056 00000100:00100000:3.0:1787893434.613888:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787893434.613896:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493485568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893434.613944:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493485568:12345-0@lo:400:kworker.0 Request processed in 48us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893434.613951:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787893434.613965:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787893434.613972:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493485056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893434.614001:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493485056:12345-0@lo:400:kworker.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893434.614007:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787893434.614037:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493485696 00000100:00100000:3.0:1787893434.614041:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493485696 00000100:00100000:3.0:1787893434.614063:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493485440 00000100:00100000:3.0:1787893434.614066:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493485440 00000100:00100000:3.0:1787893434.614078:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787893434.614083:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493485696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893434.614112:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493485696:12345-0@lo:400:kworker.0 Request processed in 28us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893434.614125:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787893434.614138:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893434.614142:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493485440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893434.614168:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493485440:12345-0@lo:400:kworker.0 Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893434.614174:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787893434.614212:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c7527480 x1874741493485696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893434.614235:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493485696:0@lo:400:kworker.0 00000100:00100000:3.0:1787893434.614245:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493485568:0@lo:400:kworker.0 00010000:00080000:3.0:1787893434.614275:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c7525500 x1874741493485440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893434.614284:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493485440:0@lo:400:kworker.0 00000100:00100000:3.0:1787893434.614293:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493485056:0@lo:400:kworker.0 00000100:00080000:0.0:1787893434.614626:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893434.614631:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493475840:0@lo:8:kworker.0 00000100:00100000:0.0:1787893434.614654:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493485184:0@lo:8:kworker.0 00000400:00000100:0.0:1787893434.614693:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493485184 offset 0 length 520: 4 00000100:00100000:0.0:1787893434.614709:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493485312:0@lo:8:kworker.0 00000400:00000100:0.0:1787893434.614728:0:3629:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741493485312 offset 0 length 520: 4 00000100:00100000:0.0:1787893434.614752:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493484928 00000100:00100000:0.0:1787893434.614756:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493484928 00000100:00100000:0.0:1787893434.614801:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787893434.614808:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+18:3632:x1874741493484928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893434.614844:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+18:3632:x1874741493484928:12345-0@lo:400:kworker.0 Request processed in 36us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893434.614851:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787893434.615011:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493484928:0@lo:400:kworker.0 00000100:00080000:3.0:1787893434.615102:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893434.615106:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893434.615109:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893434.615111:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787893435.448181:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787893435.637271:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787893436.470929:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787893437.484599:0:24266:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787893437.484603:0:24266:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787893437.484604:0:24266:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787893437.484736:0:24266:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc9e78d7800 00000020:01000004:0.0:1787893437.484752:0:24266:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787893437.484768:0:24266:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787893437.484781:0:24266:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fc8c7730000) 00000020:00000080:0.0:1787893437.484798:0:24266:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1787893437.494109:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787893437.540255:0:24266:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787893437.543729:0:24266:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787893437.544028:0:24266:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787893437.544936:0:24266:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787893437.545186:0:24266:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787893437.545430:0:24266:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787893437.545618:0:24266:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1787893437.549045:0:24266:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787893437.549266:0:24266:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787893437.549279:0:24266:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787893437.549292:0:24266:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9232577658cf27dc 00000020:01000004:2.0:1787893437.549298:0:24266:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787893437.549392:0:24266:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787893437.549396:0:24266:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787893437.549401:0:24266:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787893437.549407:0:24266:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787893437.549418:0:24266:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fc9fd338000) 00000020:00000080:2.0:1787893437.549428:0:24266:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787893437.550942:0:24266:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893437.551130:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787893437.551136:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787893437.556789:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787893437.556802:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787893437.560397:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787893437.560418:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787893437.565405:0:24266:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787893437.565671:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787893437.565687:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787893437.567024:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787893437.567035:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787893437.587221:0:24266:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787893437.589587:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787893437.589600:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787893437.594853:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787893437.594943:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787893437.595744:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787893437.595754:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787893437.598589:0:24266:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893437.599280:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787893437.599286:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787893437.600543:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787893437.600556:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787893437.656690:0:24266:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893437.656891:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787893437.656898:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787893437.665485:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787893437.665534:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787893437.666118:0:24266:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787893437.666147:0:24266:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787893437.666153:0:24266:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787893437.680353:0:24266:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787893437.680395:0:24266:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.135@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787893437.680400:0:24266:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787893437.680402:0:24266:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787893437.680403:0:24266:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787893437.680404:0:24266:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787893437.680406:0:24266:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787893437.680407:0:24266:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787893437.680409:0:24266:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787893437.680411:0:24266:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787893437.680413:0:24266:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787893437.680418:0:24266:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787893437.680420:0:24266:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787893437.680421:0:24266:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787893437.680423:0:24266:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787893437.680424:0:24266:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787893437.680425:0:24266:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787893437.680426:0:24266:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787893437.680427:0:24266:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787893437.680428:0:24266:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787893437.680429:0:24266:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787893437.680466:0:24266:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787893437.680512:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493485824:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787893437.681072:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893437.681160:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c76999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893437.681212:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493485824 00000100:00100000:2.0:1787893437.681220:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493485824 00000100:00100000:2.0:1787893437.681278:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787893437.681288:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+18:24266:x1874741493485824:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787893437.681331:0:22758:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787893437.681335:0:22758:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787893437.681339:0:22758:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787893437.681965:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+18:24266:x1874741493485824:12345-0@lo:253:mount.lustre.0 Request processed in 676us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893437.681975:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787893437.682224:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493485824:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787893437.682237:0:24266:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787893437.682241:0:24266:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787893437.682242:0:24266:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787893437.682243:0:24266:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893437.682244:0:24266:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893437.682246:0:24266:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893437.682247:0:24266:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893437.682248:0:24266:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787893437.682250:0:24266:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893437.682251:0:24266:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787893437.682271:0:24266:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc9e78d7800 from lustre-OST0000 10000000:01000000:0.0:1787893437.682298:0:24266:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787893437.682300:0:24266:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787893437.682308:0:24266:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc9d911cd28 local copy 00010000:00010000:0.0:1787893437.682317:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893437.682438:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493485952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893437.682477:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893437.682556:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1df00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893437.682969:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493485952 00000100:00100000:2.0:1787893437.682976:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493485952 00000100:00100000:2.0:1787893437.683021:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787893437.683031:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:24266:x1874741493485952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893437.683117:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+18:24266:x1874741493485952:12345-0@lo:501:mount.lustre.0 Request processed in 87us (639us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787893437.683125:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787893437.683151:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493485952:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787893437.683168:0:24266:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787893437.683203:0:24266:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787893437.683210:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893437.683219:0:24266:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893437.683243:0:24266:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc9e78d7800 10000000:01000000:3.0:1787893437.683248:0:24266:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787893437.683253:0:24266:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787893437.683256:0:24266:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787893437.683260:0:24266:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787893437.683263:0:24266:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787893437.683285:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f800/0x9232577658cf27ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893437.683294:0:24266:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f800/0x9232577658cf27ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893437.683304:0:24266:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f800/0x9232577658cf27ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893437.683330:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893437.684145:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893437.684182:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7686540 going to sleep for 11 seconds 00000100:00100000:0.0:1787893437.684258:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493486080 00000100:00100000:0.0:1787893437.684265:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493486080 00000100:00100000:0.0:1787893437.684307:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787893437.684317:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+18:24266:x1874741493486080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893437.684329:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893437.684353:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30600/0x9232577658cf27f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf27ea expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893437.684377:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30600/0x9232577658cf27f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf27ea expref: 19 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893437.684387:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30600/0x9232577658cf27f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf27ea expref: 19 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893437.684396:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30600, rc 0) 00000100:00100000:0.0:1787893437.684435:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+19:24266:x1874741493486080:12345-0@lo:101:mount.lustre.0 Request processed in 120us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893437.684442:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787893437.684473:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893437.684517:0:24266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f800/0x9232577658cf27ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27f1 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893437.684529:0:24266:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f800/0x9232577658cf27ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf27f1 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893437.686007:0:24266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1787893437.686560:0:24266:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893437.690093:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787893437.690157:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1787893437.690171:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1787893437.690184:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1787893437.690212:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1787893437.690227:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1787893437.690241:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1787893437.690255:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1787893437.690285:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1787893437.690302:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1787893437.690315:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1787893437.690329:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1787893437.690353:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1787893437.690358:0:24266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1787893437.690476:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893437.690586:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.690773:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493486208 00000100:00100000:2.0:1787893437.690782:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493486208 00000100:00100000:2.0:1787893437.690826:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787893437.690835:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+19:24266:x1874741493486208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893437.690987:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+19:24266:x1874741493486208:12345-0@lo:501:mount.lustre.0 Request processed in 153us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893437.690995:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787893437.694172:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893437.694259:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893437.694327:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486336:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893437.694408:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893437.694447:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893437.694471:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493486336 00000100:00100000:2.0:1787893437.694479:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493486336 00000100:00100000:2.0:1787893437.694594:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787893437.694603:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+19:24266:x1874741493486336:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893437.697833:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+19:24266:x1874741493486336:12345-0@lo:503:mount.lustre.0 Request processed in 3221us (3416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893437.697848:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787893437.698419:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486336:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787893437.698926:0:24266:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787893437.699027:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893437.699083:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893437.699127:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd02a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787893437.699292:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493486464 00000100:00100000:0.0:1787893437.699299:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493486464 00000100:00100000:0.0:1787893437.699349:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787893437.699358:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+19:24266:x1874741493486464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893437.700099:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+19:24266:x1874741493486464:12345-0@lo:502:mount.lustre.0 Request processed in 738us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893437.700108:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787893437.701220:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893437.701488:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787893437.701551:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787893437.701564:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787893437.701576:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787893437.701589:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787893437.701602:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787893437.701614:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787893437.701625:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787893437.702373:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1787893437.702432:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1787893437.702448:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1787893437.702459:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1787893437.702530:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893437.702599:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893437.702712:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd02a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787893437.703301:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493486592 00000100:00100000:2.0:1787893437.703310:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493486592 00000100:00100000:2.0:1787893437.703373:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787893437.703382:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+19:24266:x1874741493486592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893437.703558:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+19:24266:x1874741493486592:12345-0@lo:502:mount.lustre.0 Request processed in 177us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893437.703566:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787893437.705110:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893437.705408:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1787893437.705423:0:24266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787893437.710994:0:24283:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787893437.711009:0:24283:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787893437.711017:0:24283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893437.711019:0:24283:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787893437.711027:0:24283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787893437.711044:0:24283:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fc8c7734d28) 00000020:00000080:0.0:1787893437.711072:0:24283:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787893437.711079:0:24283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787893437.711165:0:24283:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9e78d7800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787893437.711173:0:24283:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787893437.711276:0:24283:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9232577658cf27ff 00010000:00010000:2.0:1787893437.721808:0:24283:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787893437.724020:0:24283:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1787893437.726110:0:24283:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1787893437.735171:0:24283:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787893437.735198:0:24283:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893437.735205:0:24283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893437.735207:0:24283:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787893437.735211:0:24283:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787893437.735214:0:24283:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1787893437.735215:0:24283:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893437.735217:0:24283:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787893437.735218:0:24283:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787893437.735221:0:24283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893437.735222:0:24283:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787893437.735225:0:24283:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893437.735228:0:24283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893437.735230:0:24283:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787893437.735233:0:24283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787893437.735235:0:24283:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787893437.735237:0:24283:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893437.735239:0:24283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893437.735240:0:24283:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787893437.735243:0:24283:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893437.735245:0:24283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893437.735246:0:24283:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787893437.735249:0:24283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787893437.735279:0:24283:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893437.735282:0:24283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893437.735283:0:24283:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787893437.735286:0:24283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1787893437.735701:0:24266:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787893437.735734:0:24266:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787893437.735753:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f800/0x9232577658cf27ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27f1 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.735766:0:24266:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7f800/0x9232577658cf27ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf27f1 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893437.735774:0:24266:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9e78d7800 from 1 10000000:01000000:2.0:1787893437.735777:0:24266:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893437.735813:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.735821:0:24266:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.735844:0:24266:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893437.735870:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893437.735940:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.735978:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893437.738106:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493486720 00000100:00100000:0.0:1787893437.738122:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493486720 00000100:00100000:0.0:1787893437.738205:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787893437.738216:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+19:24266:x1874741493486720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893437.738234:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893437.738252:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb30200/0x9232577658cf280d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2806 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893437.738280:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb30200/0x9232577658cf280d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2806 expref: 20 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893437.738292:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb30200/0x9232577658cf280d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2806 expref: 20 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893437.738301:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb30200, rc 0) 00000100:00100000:0.0:1787893437.738382:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+20:24266:x1874741493486720:12345-0@lo:101:mount.lustre.0 Request processed in 168us (2441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893437.738389:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787893437.738557:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893437.738576:0:24266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893437.738586:0:24266:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893437.756325:0:24266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1787893437.756857:0:24266:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893437.757093:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787893437.757117:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787893437.757131:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787893437.757146:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787893437.757164:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787893437.757204:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787893437.757222:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1787893437.757234:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1787893437.757247:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1787893437.757260:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1787893437.757273:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1787893437.757293:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1787893437.757298:0:24266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1787893437.757375:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893437.757441:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.757482:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893437.757829:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493486848 00000100:00100000:3.0:1787893437.757843:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493486848 00000100:00100000:3.0:1787893437.759965:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787893437.759983:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+20:24266:x1874741493486848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893437.760153:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+20:24266:x1874741493486848:12345-0@lo:501:mount.lustre.0 Request processed in 176us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893437.760161:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787893437.761084:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893437.761135:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893437.761207:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.761257:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893437.761317:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493486976 00000100:00100000:0.0:1787893437.761324:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493486976 00000100:00100000:0.0:1787893437.761360:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787893437.761369:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+20:24266:x1874741493486976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893437.761465:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+20:24266:x1874741493486976:12345-0@lo:503:mount.lustre.0 Request processed in 96us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893437.761472:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787893437.762139:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493486976:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787893437.762581:0:24266:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787893437.762660:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893437.762706:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.762745:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893437.762967:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493487104 00000100:00100000:0.0:1787893437.762973:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493487104 00000100:00100000:0.0:1787893437.763017:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787893437.763032:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+20:24266:x1874741493487104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893437.763126:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+20:24266:x1874741493487104:12345-0@lo:502:mount.lustre.0 Request processed in 95us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893437.763133:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787893437.763246:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893437.763472:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787893437.763531:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787893437.763547:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787893437.763560:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787893437.763573:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787893437.763586:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787893437.763598:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787893437.763622:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787893437.763653:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787893437.763668:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787893437.763683:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787893437.763714:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893437.764113:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893437.764148:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787893437.764254:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493487232 00000100:00100000:0.0:1787893437.764262:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493487232 00000100:00100000:0.0:1787893437.764294:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787893437.764302:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+20:24266:x1874741493487232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893437.764380:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+20:24266:x1874741493487232:12345-0@lo:502:mount.lustre.0 Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893437.764387:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787893437.764460:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893437.764529:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787893437.764538:0:24266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787893437.765452:0:24287:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893437.765463:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893437.765465:0:24287:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787893437.765471:0:24287:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9e78d7800 00000020:00000080:0.0:1787893437.765474:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893437.765484:0:24287:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893437.765487:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893437.765566:0:24287:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787893437.765571:0:24287:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893437.765574:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893437.765576:0:24287:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787893437.765579:0:24287:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc9e78d7800 00000020:00000080:0.0:1787893437.765581:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893437.765669:0:24287:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893437.765673:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893437.765674:0:24287:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787893437.765677:0:24287:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893437.765679:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893437.765680:0:24287:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787893437.765690:0:24287:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9e78d7800 00000020:00000080:0.0:1787893437.765692:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893437.765709:0:24287:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893437.765712:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893437.765713:0:24287:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787893437.765715:0:24287:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893437.765717:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893437.765718:0:24287:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787893437.765721:0:24287:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc9e78d7800 00000020:00000080:0.0:1787893437.765723:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893437.765743:0:24287:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893437.765745:0:24287:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893437.765747:0:24287:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787893437.765749:0:24287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1787893437.765829:0:24266:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787893437.765859:0:24266:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787893437.765876:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.765887:0:24266:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893437.765933:0:24266:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787893437.765936:0:24266:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc9e78d7800 10000000:01000000:2.0:1787893437.765938:0:24266:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc9e78d7800 10000000:01000000:2.0:1787893437.765943:0:24266:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787893437.765948:0:24266:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc9e78d7800 from 1 10000000:01000000:2.0:1787893437.765951:0:24266:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787893437.765981:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf2814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.765989:0:24266:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf2814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.766000:0:24266:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf2814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893437.766018:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893437.766073:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.766112:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787893437.766161:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493487360 00000100:00100000:0.0:1787893437.766167:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493487360 00000100:00100000:0.0:1787893437.766217:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787893437.766227:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+20:24266:x1874741493487360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893437.766237:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893437.766248:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31200/0x9232577658cf281b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2814 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893437.766268:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31200/0x9232577658cf281b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2814 expref: 21 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893437.766278:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31200/0x9232577658cf281b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2814 expref: 21 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893437.766287:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31200, rc 0) 00000100:00100000:0.0:1787893437.766318:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493487360:12345-0@lo:101:mount.lustre.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893437.766333:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787893437.766403:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893437.766417:0:24266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf2814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf281b expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.766426:0:24266:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf2814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf281b expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893437.768076:0:24266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1787893437.768328:0:24266:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893437.768482:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787893437.768548:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1787893437.768563:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1787893437.768576:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1787893437.768603:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1787893437.768617:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1787893437.768631:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1787893437.769307:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1787893437.769330:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787893437.769343:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1787893437.769356:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1787893437.769369:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1787893437.769381:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1787893437.769393:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1787893437.769405:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1787893437.769418:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1787893437.769429:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1787893437.769441:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1787893437.769453:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1787893437.769465:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1787893437.769525:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1787893437.769539:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1787893437.769552:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1787893437.769564:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1787893437.769578:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1787893437.769590:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1787893437.769602:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1787893437.769614:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1787893437.769625:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1787893437.769650:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1787893437.769665:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1787893437.769677:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1787893437.769689:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1787893437.769702:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1787893437.769715:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1787893437.769727:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1787893437.770609:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1787893437.771158:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1787893437.771184:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1787893437.771223:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1787893437.771244:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1787893437.771260:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1787893437.771276:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1787893437.771290:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1787893437.771303:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1787893437.771316:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1787893437.771329:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1787893437.771343:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1787893437.771540:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1787893437.771561:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1787893437.771580:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1787893437.771585:0:24266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1787893437.771703:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893437.771776:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.771829:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893437.774119:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493487488 00000100:00100000:3.0:1787893437.774133:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493487488 00000100:00100000:3.0:1787893437.774213:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787893437.774225:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493487488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893437.774389:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493487488:12345-0@lo:501:mount.lustre.0 Request processed in 166us (2612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893437.774397:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787893437.775131:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893437.775177:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893437.775240:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.775279:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893437.776797:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493487616 00000100:00100000:0.0:1787893437.776808:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493487616 00000100:00100000:0.0:1787893437.776865:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787893437.776875:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493487616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893437.777018:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493487616:12345-0@lo:503:mount.lustre.0 Request processed in 144us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893437.777026:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787893437.777255:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487616:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787893437.777872:0:24266:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787893437.777986:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893437.778037:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.778079:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787893437.778218:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493487744 00000100:00100000:0.0:1787893437.778224:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493487744 00000100:00100000:0.0:1787893437.778265:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787893437.778274:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493487744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893437.778365:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493487744:12345-0@lo:502:mount.lustre.0 Request processed in 90us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893437.778372:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787893437.778446:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893437.778632:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787893437.778860:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787893437.778873:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787893437.778886:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787893437.778899:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787893437.778912:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787893437.778925:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787893437.778939:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787893437.778952:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787893437.778964:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787893437.778976:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787893437.778987:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787893437.778998:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787893437.779010:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787893437.779038:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787893437.779061:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787893437.779074:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787893437.779086:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787893437.779099:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787893437.779111:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787893437.779122:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787893437.779135:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787893437.779147:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787893437.779161:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787893437.779175:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787893437.779199:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787893437.779214:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787893437.779225:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787893437.779237:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787893437.779250:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787893437.779276:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787893437.779291:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787893437.779303:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787893437.779315:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787893437.779328:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787893437.779341:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787893437.779354:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787893437.779366:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787893437.779378:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787893437.779390:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787893437.779402:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787893437.779414:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787893437.779426:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787893437.779439:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787893437.779452:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787893437.779463:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787893437.780807:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787893437.780864:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787893437.780932:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893437.780998:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.781043:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493487872 00000100:00100000:2.0:1787893437.781049:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493487872 00000100:00100000:2.0:1787893437.781094:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787893437.781103:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493487872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893437.781212:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493487872:12345-0@lo:502:mount.lustre.0 Request processed in 110us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893437.781220:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787893437.781270:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893437.781287:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493487872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893437.781441:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787893437.781461:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787893437.781480:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493488000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893437.781531:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.781554:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493488000 00000100:00100000:2.0:1787893437.781557:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493488000 00000100:00100000:2.0:1787893437.781580:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787893437.781586:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493488000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893437.781641:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493488000:12345-0@lo:502:mount.lustre.0 Request processed in 55us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893437.787354:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787893437.787455:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893437.787507:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493488000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893437.787603:0:24266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787893437.787618:0:24266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787893437.800711:0:24290:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787893437.800728:0:24290:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fc9fe140000) 00000020:00000080:1.0:1787893437.800752:0:24290:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1787893437.800858:0:24290:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9e78d7800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787893437.800862:0:24290:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9e78d7800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787893437.800864:0:24290:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9e78d7800 3 00010000:00080000:1.0:1787893437.800894:0:24290:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c7190000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.135@tcp at head 00010000:00010000:1.0:1787893437.809852:0:24290:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787893437.812962:0:24290:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787893437.813013:0:24290:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787893437.813026:0:24290:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9232577658cf2829 00000100:00080000:0.0:1787893437.813037:0:24290:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787893437.813044:0:24290:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc8c7190000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893437.813078:0:24290:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8483800 x1874741493488128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893437.813118:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493488128:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787893437.813199:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787893437.813309:0:24290:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787893437.813363:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893437.813367:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893437.813369:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893437.813372:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893437.813402:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893437.813405:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893437.813408:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893437.813410:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787893437.813437:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493488256:0@lo:400:kworker.0 00000100:00100000:0.0:1787893437.813484:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893437.813549:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893437.813556:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493488384:0@lo:400:kworker.0 00000100:00100000:0.0:1787893437.813582:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893437.816015:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493488512:0@lo:400:kworker.0 00000100:00100000:0.0:1787893437.816066:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893437.816087:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893437.816094:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493488640:0@lo:400:kworker.0 00000100:00100000:0.0:1787893437.816114:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893437.816253:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493488128 00000100:00100000:3.0:1787893437.816261:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493488128 00000100:00100000:3.0:1787893437.816294:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493488384 00000100:00100000:3.0:1787893437.816296:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493488384 00000100:00100000:3.0:1787893437.816321:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787893437.816329:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493488384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893437.816382:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493488384:12345-0@lo:400:kworker.0 Request processed in 53us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893437.816389:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787893437.816407:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787893437.816411:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493488128:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787893437.816433:0:22763:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:3.0:1787893437.816468:0:22763:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9232577658cf2830 00000004:00100000:3.0:1787893437.816484:0:22763:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787893437.816543:0:22763:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7d1c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787893437.816583:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1874741493488128:12345-0@lo:38:llog_process_th.0 Request processed in 170us (3384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893437.816591:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787893437.821308:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493488256 00000100:00100000:2.0:1787893437.821325:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493488256 00000100:00100000:2.0:1787893437.821374:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493488512 00000100:00100000:2.0:1787893437.821377:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493488512 00000100:00100000:2.0:1787893437.821397:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787893437.821406:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493488256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893437.821507:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493488256:12345-0@lo:400:kworker.0 Request processed in 101us (8024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893437.821515:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787893437.821534:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787893437.821540:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493488512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893437.821585:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493488512:12345-0@lo:400:kworker.0 Request processed in 45us (5519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893437.821592:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787893437.823087:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493488512:0@lo:400:kworker.0 00010000:00080000:0.0:1787893437.823133:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c8481180 x1874741493488384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893437.823144:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493488384:0@lo:400:kworker.0 00000100:00100000:0.0:1787893437.823173:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493488256:0@lo:400:kworker.0 00010000:00080000:0.0:1787893437.823217:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c8483800 x1874741493488128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893437.823225:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787893437.823233:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1787893437.823240:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787893437.823245:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787893437.823247:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7190000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787893437.823253:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3629:1874741493488128:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787893437.824071:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493488640 00000100:00100000:0.0:1787893437.824080:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493488640 00000100:00100000:0.0:1787893437.824126:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787893437.824136:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493488640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893437.824221:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493488640:12345-0@lo:400:kworker.0 Request processed in 87us (8105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893437.824229:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787893437.824264:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc8c8480a80 x1874741493488640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893437.824275:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493488640:0@lo:400:kworker.0 00000020:01000004:2.0:1787893437.833252:0:24290:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787893437.833270:0:24290:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9fc9fd3399b8) 00000020:00000080:2.0:1787893437.833295:0:24290:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1787893437.833408:0:24290:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc9e78d7800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787893437.833412:0:24290:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc9e78d7800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787893437.833415:0:24290:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc9e78d7800 3 00010000:00080000:2.0:1787893437.833445:0:24290:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c779a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.135@tcp at head 00010000:00010000:2.0:1787893437.840038:0:24290:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787893437.843521:0:24290:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787893437.843582:0:24290:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787893437.843599:0:24290:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9232577658cf283e 00000100:00080000:2.0:1787893437.843612:0:24290:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893437.843618:0:24290:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9fc8c779a800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893437.843657:0:24290:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9c3e6d180 x1874741493488768/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893437.843705:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1874741493488768:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787893437.843779:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.843846:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493488768 00000100:00100000:2.0:1787893437.843853:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493488768 00000100:00100000:2.0:1787893437.843885:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893437.843893:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1874741493488768:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787893437.843918:0:22765:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:2.0:1787893437.843973:0:22765:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9232577658cf2845 00000004:00100000:2.0:1787893437.843989:0:22765:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787893437.844021:0:22765:0:(import.c:65:import_set_state_nolock()) ffff9fc8c779b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893437.844072:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1874741493488768:12345-0@lo:38:llog_process_th.0 Request processed in 178us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893437.844080:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787893437.844124:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc9c3e6d180 x1874741493488768/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893437.844134:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787893437.844142:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787893437.844148:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787893437.844153:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787893437.844156:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c779a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787893437.844163:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3629:1874741493488768:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787893437.844183:0:24290:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787893437.847926:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893437.847933:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893437.847935:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893437.847938:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893437.847948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893437.847951:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893437.847953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893437.847955:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787893437.863778:0:24290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1787893437.864179:0:24266:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787893437.864222:0:24266:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787893437.864249:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf2814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf281b expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893437.864261:0:24266:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e0000/0x9232577658cf2814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf281b expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787893437.864320:0:24266:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787893437.864323:0:24266:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787893437.864324:0:24266:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787893437.864325:0:24266:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787893437.864327:0:24266:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787893437.864328:0:24266:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787893437.864330:0:24266:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787893437.864332:0:24266:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787893437.864333:0:24266:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787893437.864337:0:24266:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787893437.864339:0:24266:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787893437.864340:0:24266:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787893437.864341:0:24266:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787893437.864342:0:24266:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787893437.864343:0:24266:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787893437.864344:0:24266:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787893437.864346:0:24266:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787893437.864347:0:24266:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787893437.864347:0:24266:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787893437.864373:0:24266:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787893437.864395:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7527480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493488896:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787893437.864466:0:24266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893437.864726:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787893437.865018:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493488896 00000100:00100000:0.0:1787893437.865026:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493488896 00000100:00100000:0.0:1787893437.865078:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787893437.865090:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493488896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787893437.865116:0:22755:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787893437.865130:0:22755:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787893437.873363:0:22755:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787893437.873385:0:22755:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787893437.873560:0:22779:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787893437.873566:0:22779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787893437.873588:0:22779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893437.873605:0:22779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf2796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf278f expref: 21 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893437.873614:0:22779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf27a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf279d expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893437.873621:0:22779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893437.873646:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:24266:x1874741493488896:12345-0@lo:253:mount.lustre.0 Request processed in 8546us (9166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893437.873658:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:3.0:1787893437.873659:0:22779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf27a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf279d expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893437.873666:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7527480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:24266:1874741493488896:0@lo:253:mount.lustre.0 00010000:00010000:3.0:1787893437.873678:0:22779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf27a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf279d expref: 20 pid: 22758 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893437.873690:0:24266:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000100:00100000:3.0:1787893437.873694:0:22779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7527100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493489024:0@lo:104: 00000020:01000004:0.0:1787893437.873695:0:24266:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787893437.873699:0:24266:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787893437.873703:0:24266:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893437.873704:0:24266:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893437.873706:0:24266:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893437.873707:0:24266:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893437.873709:0:24266:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787893437.873711:0:24266:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893437.873713:0:24266:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787893437.873731:0:24266:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787893437.873738:0:22779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787893437.873790:0:22779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf2796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf278f expref: 20 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893437.873797:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493489024 00010000:00010000:3.0:1787893437.873800:0:22779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf2796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf278f expref: 20 pid: 22755 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893437.873805:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493489024 00000100:00100000:3.0:1787893437.873814:0:22779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7526680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493489152:0@lo:104: 00000100:00100000:2.0:1787893437.873846:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893437.873847:0:22779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.873857:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+3:22779:x1874741493489024:12345-0@lo:104: 00000100:00100000:3.0:1787893437.873871:0:22779:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1d1d600 going to sleep for 11 seconds 00010000:00010000:2.0:1787893437.873871:0:22746:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.873928:0:22746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787893437.873935:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+3:22779:x1874741493489024:12345-0@lo:104: Request processed in 80us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893437.873936:0:22779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7527100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493489024:0@lo:104: 00000100:00100000:2.0:1787893437.873948:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787893437.873969:0:22746:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787893437.873977:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493489152 00000100:00100000:2.0:1787893437.873979:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493489152 00000100:00100000:2.0:1787893437.873996:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787893437.874002:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9edff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+3:22779:x1874741493489152:12345-0@lo:104: 00010000:00010000:2.0:1787893437.874010:0:22746:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874060:0:22746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787893437.874065:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9edff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+3:22779:x1874741493489152:12345-0@lo:104: Request processed in 64us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893437.874071:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787893437.874105:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787893437.874111:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874124:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1400 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893437.874128:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874137:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893437.874144:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893437.874150:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787893437.874175:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874182:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893437.874205:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893437.874221:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874229:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf279d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf27a4 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874240:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893437.874242:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893437.874243:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893437.874261:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493489280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893437.874288:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893437.874321:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493489280 00000100:00100000:2.0:1787893437.874325:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493489280 00010000:00010000:2.0:1787893437.874340:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf27a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf279d expref: 21 pid: 22758 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893437.874375:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787893437.874382:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:3630:x1874741493489280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893437.874392:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893437.874398:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf27a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf279d expref: 21 pid: 22758 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874409:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf27a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf279d expref: 21 pid: 22758 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874423:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf27a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf279d expref: 21 pid: 22758 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874435:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893437.874454:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893437.874463:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893437.874470:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+20:3630:x1874741493489280:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (179us total) trans 0 rc 0/0 00010000:00010000:1.0:1787893437.874475:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1600 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:1.0:1787893437.874480:0:22752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893437.874481:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787893437.874518:0:22752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893437.874533:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493489280:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1787893437.874539:0:22752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893437.874546:0:22752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787893437.874572:0:22752:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893437.874578:0:22752:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893437.874603:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893437.874610:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1600/0x9232577658cf278f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf2796 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893437.874624:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893437.874627:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893437.874629:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893437.874631:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787893437.874636:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893437.874640:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893437.874644:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493489408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893437.874719:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893437.874745:0:22779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7526680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493489152:0@lo:104: 00010000:00010000:3.0:1787893437.874768:0:22779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893437.874800:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493489408 00000100:00100000:2.0:1787893437.874805:0:23919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493489408 00010000:00010000:2.0:1787893437.874818:0:23919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf2796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf278f expref: 20 pid: 22755 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893437.874845:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787893437.874851:0:23919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c759f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afca6d2b-351c-4adb-95b2-d9dd13744042+20:3630:x1874741493489408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893437.874859:0:23919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893437.874864:0:23919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf2796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf278f expref: 20 pid: 22755 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874883:0:23919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf2796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf278f expref: 20 pid: 22755 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874893:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf2796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf278f expref: 20 pid: 22755 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874905:0:23919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874912:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787893437.874923:0:23919:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017661601s 00010000:00010000:2.0:1787893437.874928:0:23919:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874934:0:23919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874940:0:23919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874946:0:23919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874951:0:23919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893437.874954:0:23919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874961:0:23919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874987:0:23919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893437.874996:0:23919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893437.875032:0:23919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c759f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afca6d2b-351c-4adb-95b2-d9dd13744042+19:3630:x1874741493489408:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893437.875039:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787893437.875045:0:22779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893437.875050:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493489408:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893437.875056:0:22779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893437.875069:0:22779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c7c7f200/0x9232577658cf284c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787893437.876072:0:24266:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1787893437.881099:0:24266:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787893437.881107:0:24266:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787893437.881136:0:24266:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787893437.881166:0:24266:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787893437.881181:0:24266:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787893437.881210:0:24266:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787893437.881896:0:24266:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787893437.882092:0:24266:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787893438.514412:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893438.641603:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893438.641624:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493489536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893438.641687:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893438.641735:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493489536 00000100:00100000:2.0:1787893438.641743:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493489536 00000100:00100000:2.0:1787893438.641785:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787893438.641793:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493489536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893438.641828:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787893438.641873:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493489536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893438.641880:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787893438.641922:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493489536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893438.645534:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893438.645558:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493489664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893438.645627:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893438.645690:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493489664 00000100:00100000:0.0:1787893438.645697:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493489664 00000100:00100000:0.0:1787893438.645738:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787893438.645747:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493489664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893438.645783:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787893438.645832:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493489664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893438.645840:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787893438.645882:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493489664:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1787893438.766926:0:24347:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787893438.767138:0:24347:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787893439.090767:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787893439.090775:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ffc1a000 from 13 10000000:01000000:2.0:1787893439.090781:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787893439.090827:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893439.090853:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893439.090865:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893439.090891:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493489792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893439.090966:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893439.096930:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893439.096969:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493489792 00000100:00100000:2.0:1787893439.096979:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493489792 00000100:00100000:2.0:1787893439.097036:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787893439.097047:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+19:22761:x1874741493489792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893439.097063:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893439.097084:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e1600/0x9232577658cf285a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2853 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893439.097112:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e1600/0x9232577658cf285a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2853 expref: 20 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893439.097123:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c67e1600/0x9232577658cf285a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2853 expref: 20 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893439.097133:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1600, rc 0) 00000100:00100000:2.0:1787893439.097209:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+20:22761:x1874741493489792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (6240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893439.097215:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787893439.097284:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493489792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893439.097313:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893439.097323:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893439.097378:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493489920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787893439.097417:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893439.097432:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893439.097445:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493489920 00000100:00100000:2.0:1787893439.097448:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493489920 00000100:00100000:2.0:1787893439.097468:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787893439.097473:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+20:22761:x1874741493489920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787893439.097485:0:22755:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787893439.097516:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787893439.097519:0:22755:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787893439.097592:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+20:22761:x1874741493489920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893439.097599:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787893439.097642:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493489920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787893439.098019:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787893439.098026:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893439.098035:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893439.098054:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787893439.098056:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9c425c800 from 13 10000000:01000000:2.0:1787893439.098060:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787893439.098079:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893439.098086:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893439.098094:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893439.098107:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493490048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893439.098136:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893439.098210:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9edf37300 going to sleep for 11 seconds 00000100:00100000:1.0:1787893439.109957:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493490048 00000100:00100000:1.0:1787893439.109974:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493490048 00000100:00100000:0.0:1787893439.110130:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787893439.110142:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+20:22761:x1874741493490048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893439.110160:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893439.110197:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf2868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2861 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893439.110227:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf2868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2861 expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893439.110239:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf2868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2861 expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893439.110249:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31c00, rc 0) 00000100:00100000:0.0:1787893439.110340:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+21:22761:x1874741493490048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (12203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893439.110348:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787893439.110408:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493490048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893439.110425:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893439.110435:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893439.110527:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493490176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787893439.110567:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893439.110597:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7699180 going to sleep for 11 seconds 00000100:00100000:0.0:1787893439.110611:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493490176 00000100:00100000:0.0:1787893439.110615:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493490176 00000100:00100000:0.0:1787893439.110823:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787893439.110831:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:22761:x1874741493490176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787893439.110845:0:22757:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787893439.110868:0:22757:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787893439.110871:0:22757:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1787893439.110945:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:22761:x1874741493490176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893439.110952:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787893439.110981:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493490176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787893439.111033:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787893439.111040:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893439.111048:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893439.537980:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893440.575218:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787893441.010361:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787893441.595044:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893442.609645:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893443.251972:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493490304:0@lo:400:kworker.0 00000100:00100000:3.0:1787893443.252044:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787893443.252132:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893443.252147:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893443.252150:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893443.252153:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893443.252177:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893443.252180:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893443.252183:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893443.252185:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787893443.252376:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493490816:0@lo:400:kworker.0 00000100:00100000:3.0:1787893443.252405:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893443.252514:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493490304 00000100:00100000:1.0:1787893443.252523:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493490304 00000100:00100000:1.0:1787893443.252566:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787893443.252576:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:3630:x1874741493490304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.252646:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493490432:0@lo:400:kworker.0 00000100:00100000:3.0:1787893443.252723:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493490816 00000100:00100000:3.0:1787893443.252727:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493490816 00000100:00100000:3.0:1787893443.252753:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787893443.252760:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493490816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893443.256400:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:3630:x1874741493490304:12345-0@lo:400:kworker.0 Request processed in 3817us (4346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893443.256523:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787893443.256597:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493490304:0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.257558:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893443.257597:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493490944:0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.257635:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893443.257673:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493490560:0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.257699:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893443.257711:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493491072:0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.257730:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893443.257743:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893443.257749:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493490688:0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.257769:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893443.257805:0:22765:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787893443.257813:0:22765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787893443.257833:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493490432 00000100:00100000:2.0:1787893443.257840:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493490432 00000100:00100000:2.0:1787893443.257874:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493490688 00000100:00100000:2.0:1787893443.257877:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493490688 00000100:00100000:2.0:1787893443.257891:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787893443.257899:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493490432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.257954:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493490432:12345-0@lo:400:kworker.0 Request processed in 55us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893443.257960:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787893443.257978:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787893443.257984:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493490688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.258013:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493490688:12345-0@lo:400:kworker.0 Request processed in 29us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893443.258018:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787893443.258041:0:22763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787893443.258047:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493490944 00000100:00100000:2.0:1787893443.258049:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493490944 00000100:00100000:2.0:1787893443.258082:0:22763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787893443.258087:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493490560 00000100:00100000:2.0:1787893443.258090:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493490560 00000100:00100000:2.0:1787893443.258098:0:22763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787893443.258102:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493491072 00000100:00100000:2.0:1787893443.258104:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493491072 00000100:00100000:2.0:1787893443.258115:0:22763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787893443.258122:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787893443.258128:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493490944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.258172:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3631:x1874741493490944:12345-0@lo:400:kworker.0 Request processed in 44us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893443.258178:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787893443.258189:0:22763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787893443.258195:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787893443.258200:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493490560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.258239:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493490560:12345-0@lo:400:kworker.0 Request processed in 38us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893443.258244:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787893443.258254:0:22763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787893443.258259:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787893443.258265:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493491072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.258289:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493491072:12345-0@lo:400:kworker.0 Request processed in 25us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893443.258295:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787893443.258403:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493490688:0@lo:400:kworker.0 00010000:00080000:2.0:1787893443.258415:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9c3e6e300 x1874741493490560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787893443.258781:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893443.258785:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893443.259145:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493490560:0@lo:400:kworker.0 00010000:00080000:2.0:1787893443.259163:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9c3e6d500 x1874741493491072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893443.259172:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493491072:0@lo:400:kworker.0 00000100:00100000:2.0:1787893443.259272:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493490432:0@lo:400:kworker.0 00010000:00080000:2.0:1787893443.259285:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9c3e6ce00 x1874741493490944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893443.259294:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3631:1874741493490944:0@lo:400:kworker.0 00000100:00100000:3.0:1787893443.265785:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493490816:12345-0@lo:400:kworker.0 Request processed in 13017us (13371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893443.265800:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787893443.265913:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9c3e6ca80 x1874741493490816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893443.265929:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493490816:0@lo:400:kworker.0 00010000:00010000:1.0:1787893443.633761:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893443.762108:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893443.762145:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493491200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893443.762212:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893443.762262:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493491200 00000100:00100000:1.0:1787893443.762269:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493491200 00000100:00100000:1.0:1787893443.762316:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787893443.762326:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493491200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787893443.762357:0:23786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787893443.762399:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493491200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893443.762406:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787893443.762451:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493491200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893443.778371:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493491328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893443.778444:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893443.778523:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493491328 00000100:00100000:2.0:1787893443.778530:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493491328 00000100:00100000:2.0:1787893443.778580:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787893443.778602:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493491328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893443.778657:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787893443.778700:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493491328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893443.778707:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787893443.778754:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493491328:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787893444.662384:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787893444.885377:0:24638:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787893445.682652:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787893445.883322:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1787893446.044763:0:24690:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787893446.045005:0:24690:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787893446.705771:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787893446.865946:0:24741:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787893446.866209:0:24741:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787893447.743983:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893448.114394:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893433/real 1787893433] req@ffff9fc9fa52b800 x1874741493484800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893448 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893448.114683:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9fa52b800 x1874741493484800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893448 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893448.114717:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893433/real 1787893433] req@ffff9fc9e711c700 x1874741493484544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893448 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893448.114732:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9e711c700 x1874741493484544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893448 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787893448.114757:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5fdd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787893448.114830:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787893448.114835:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493484800:0@lo:8:kworker.0 00000100:00080000:3.0:1787893448.114841:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893448.115037:0:22171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893448.115042:0:22171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893448.115045:0:22171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893448.115048:0:22171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893448.115064:0:22171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893448.115067:0:22171:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787893448.115087:0:22171:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5fdd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893448.115100:0:22171:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 677 00000100:00080000:1.0:1787893448.115106:0:22171:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787893448.115116:0:22171:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc9c5fdd000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893448.115144:0:22171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fa529180 x1874741493491968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893448.115154:0:22171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893448.115157:0:22171:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787893448.115159:0:22171:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893448.115162:0:22171:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 677 00000100:00080000:1.0:1787893448.115165:0:22171:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787893448.115169:0:22171:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc8c75fc000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893448.115180:0:22171:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9fa529f80 x1874741493492096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893448.115241:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493491840:0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.115337:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893448.115407:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787893448.115414:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493491456:0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.115460:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893448.115487:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493492224:0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.115538:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893448.115581:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493491584:0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.116368:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893448.116407:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493492352:0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.116470:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893448.116528:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787893448.116535:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493491712:0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.116572:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893448.116594:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493492480:0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.116621:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893448.116666:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493491840 00000100:00100000:1.0:1787893448.116676:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493491840 00000100:00100000:1.0:1787893448.116731:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493491584 00000100:00100000:1.0:1787893448.116735:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493491584 00000100:00100000:1.0:1787893448.116754:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787893448.116764:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493491840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.116837:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493491840:12345-0@lo:400:kworker.0 Request processed in 73us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893448.116845:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787893448.116866:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787893448.116872:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493491584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.116907:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493491584:12345-0@lo:400:kworker.0 Request processed in 35us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893448.116914:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787893448.116936:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493491456 00000100:00100000:1.0:1787893448.116940:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493491456 00000100:00100000:1.0:1787893448.117189:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787893448.117201:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:3630:x1874741493491456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.117401:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:3630:x1874741493491456:12345-0@lo:400:kworker.0 Request processed in 203us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893448.117420:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787893448.117471:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493492224 00000100:00100000:1.0:1787893448.117476:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493492224 00000100:00100000:0.0:1787893448.117577:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493492352 00000100:00100000:0.0:1787893448.117582:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493492352 00000100:00100000:0.0:1787893448.117616:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493491712 00000100:00100000:0.0:1787893448.117619:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493491712 00000100:00100000:0.0:1787893448.117629:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493492480 00000100:00100000:0.0:1787893448.117631:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493492480 00000100:00100000:0.0:1787893448.117645:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787893448.117650:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493492352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893448.117690:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493492352:12345-0@lo:400:kworker.0 Request processed in 40us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893448.117696:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787893448.117711:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787893448.117725:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493491712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893448.117757:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493491712:12345-0@lo:400:kworker.0 Request processed in 33us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893448.117762:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787893448.117775:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787893448.117782:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493492480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893448.117811:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493492480:12345-0@lo:400:kworker.0 Request processed in 30us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893448.117817:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787893448.117842:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787893448.117846:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893448.118057:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893448.118065:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493492224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.118221:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493492224:12345-0@lo:400:kworker.0 Request processed in 157us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893448.118228:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893448.118346:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493491456:0@lo:400:kworker.0 00010000:00080000:1.0:1787893448.118364:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9fa52a680 x1874741493492224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893448.118378:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493492224:0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.118389:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493491840:0@lo:400:kworker.0 00010000:00080000:1.0:1787893448.118432:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9fa528a80 x1874741493491712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893448.118731:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493491712:0@lo:400:kworker.0 00010000:00080000:1.0:1787893448.118750:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c8506680 x1874741493492480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893448.118760:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493492480:0@lo:400:kworker.0 00000100:00100000:1.0:1787893448.118774:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493491584:0@lo:400:kworker.0 00010000:00080000:1.0:1787893448.118786:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9fa528000 x1874741493492352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893448.118810:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493492352:0@lo:400:kworker.0 00000100:00080000:3.0:1787893448.119047:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787893448.119054:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493484544:0@lo:8:kworker.0 00000100:00100000:3.0:1787893448.119168:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493491968:0@lo:8:kworker.0 00000100:00100000:3.0:1787893448.119360:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893448.119456:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493492096:0@lo:8:kworker.0 00000100:00100000:3.0:1787893448.119481:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787893448.120417:0:22171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893448.120425:0:22171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893448.120428:0:22171:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893448.120431:0:22171:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787893448.129085:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493491968 00000100:00100000:0.0:1787893448.129117:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493491968 00000100:00100000:0.0:1787893448.129191:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493492096 00000100:00100000:0.0:1787893448.129196:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493492096 00000100:00100000:0.0:1787893448.129227:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787893448.129237:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493491968:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787893448.129289:0:24270:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:0.0:1787893448.129333:0:24270:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf286f 00002000:00100000:0.0:1787893448.129355:0:24270:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9fc8c7d93000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787893448.129360:0:24270:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787893448.129364:0:24270:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787893448.129625:0:24270:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787893448.129658:0:24270:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7d90000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893448.129764:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3629:x1874741493491968:12345-0@lo:8:kworker.0 Request processed in 527us (10404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893448.129773:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787893448.129804:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787893448.129809:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493492096:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787893448.129824:0:24270:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1787893448.133417:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9fa529180 x1874741493491968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787893468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893448.133437:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787893448.133450:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787893448.133463:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787893448.133471:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787893448.133476:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9c5fdd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787893448.133526:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787893448.133534:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493491968:0@lo:8:kworker.0 00000004:00080000:3.0:1787893448.133623:0:23506:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787893448.133650:0:23506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23506:1874741493492736:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787893448.133724:0:23506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893448.133751:0:23506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c67dc780 going to sleep for 11 seconds 00000100:00100000:1.0:1787893448.135380:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493492736 00000100:00100000:1.0:1787893448.135399:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493492736 00000100:00100000:1.0:1787893448.135432:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493492608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893448.135526:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893448.136218:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493492608 00000100:00100000:3.0:1787893448.136227:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493492608 00000100:00100000:3.0:1787893448.136406:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893448.136420:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1874741493492608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893448.136466:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787893448.136639:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1874741493492608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 221us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893448.136648:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787893448.137079:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787893448.137185:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c7524e00 x1874741493492608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893448.137336:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493492608:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1787893448.137641:0:23505:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787893448.137770:0:23505:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 691959278004ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787893448.137778:0:23505:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1787893448.143813:0:23497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787893448.183890:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493492096:12345-0@lo:8:kworker.0 Request processed in 54065us (64393us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787893448.183915:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893448.183964:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787893448.184136:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893448.184144:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787893448.184148:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493492096:0@lo:8:kworker.0 00000100:00100000:2.0:1787893448.184462:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23506:x1874741493492736:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1787893448.197423:0:24270:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787893448.197436:0:24270:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1787893448.198371:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23506:x1874741493492736:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13910us (64637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893448.198387:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787893448.207357:0:23506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c7525880 x1874741493492736/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787893464 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893448.207384:0:23506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23506:1874741493492736:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787893448.207401:0:23506:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787893448.207721:0:23506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23506:1874741493492864:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787893448.207820:0:23506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893448.207867:0:23506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e7016780 going to sleep for 11 seconds 00000100:00100000:0.0:1787893448.207977:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493492864 00000100:00100000:0.0:1787893448.207986:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493492864 00000100:00100000:0.0:1787893448.208054:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893448.208066:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23506:x1874741493492864:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787893448.208112:0:24273:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1787893448.208170:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23506:x1874741493492864:12345-0@lo:5:osp-pre-0-1.0 Request processed in 106us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893448.208177:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787893448.208933:0:23506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ffb9df80 x1874741493492864/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787893464 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893448.208950:0:23506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23506:1874741493492864:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787893448.209100:0:23506:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787893448.209154:0:23506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23506:1874741493492992:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787893448.209200:0:23506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893448.211333:0:23506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c67dc780 going to sleep for 11 seconds 00000100:00100000:2.0:1787893448.218150:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493492992 00000100:00100000:2.0:1787893448.218171:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493492992 00000100:00100000:3.0:1787893448.219822:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787893448.219854:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23506:x1874741493492992:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787893448.220036:0:24272:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:2.0:1787893448.273775:0:24267:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1787893448.273802:0:24267:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787893448.280541:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23506:x1874741493492992:12345-0@lo:5:osp-pre-0-1.0 Request processed in 60642us (71290us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787893448.280562:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787893448.280936:0:23506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c7525880 x1874741493492992/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787893464 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893448.280953:0:23506:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787893448.280964:0:23506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23506:1874741493492992:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787893448.281061:0:23506:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1787893448.281148:0:23506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23506:1874741493493120:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787893448.281355:0:23506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893448.281408:0:23506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c870a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787893448.281454:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493493120 00000100:00100000:1.0:1787893448.281462:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493493120 00000100:00100000:2.0:1787893448.286190:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893448.286211:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23506:x1874741493493120:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787893448.286333:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23506:x1874741493493120:12345-0@lo:900:osp-pre-0-1.0 Request processed in 130us (4979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893448.286341:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787893448.286426:0:23506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c8505f80 x1874741493493120/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787893464 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893448.286443:0:23506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23506:1874741493493120:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1787893448.754706:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893448.882029:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893448.882053:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493493248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893448.882138:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893448.882190:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493493248 00000100:00100000:2.0:1787893448.882198:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493493248 00000100:00100000:2.0:1787893448.882263:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787893448.882273:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493493248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893448.882307:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787893448.882351:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493493248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893448.882359:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787893448.882404:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493493248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893448.886194:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893448.886214:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493493376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893448.886280:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893448.886327:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493493376 00000100:00100000:0.0:1787893448.886334:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493493376 00000100:00100000:0.0:1787893448.886386:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787893448.886395:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493493376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893448.886429:0:23786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787893448.886474:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493493376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893448.886482:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787893448.886542:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493493376:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787893449.777843:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893450.804937:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787893451.254622:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787893451.826860:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893452.849973:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893453.490512:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00080000:2.0:1787893453.490530:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893453.490535:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893453.490538:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893453.490541:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893453.490543:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493493504:0@lo:400:kworker.0 00000100:00080000:2.0:1787893453.490561:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893453.490564:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787893453.490568:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893453.490574:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 691 00000100:00080000:2.0:1787893453.490581:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787893453.490589:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc8c75fc000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893453.490613:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9ffb9c000 x1874741493494272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893453.490646:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893453.490662:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493494144:0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.490697:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893453.490726:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787893453.490732:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493494016:0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.490757:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893453.490804:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493494656:0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.490831:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893453.490861:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493493760:0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.490884:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893453.490903:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493494400:0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.490927:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893453.490947:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787893453.490952:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493493888:0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.490973:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893453.490987:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493494528:0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.491006:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893453.491035:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493494272:0@lo:8:kworker.0 00000100:00100000:1.0:1787893453.491239:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493493632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893453.491268:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893453.491309:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493493504 00000100:00100000:1.0:1787893453.491318:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493493504 00000100:00100000:1.0:1787893453.491376:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787893453.491385:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+21:3632:x1874741493493504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893453.491439:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+21:3632:x1874741493493504:12345-0@lo:400:kworker.0 Request processed in 55us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893453.491447:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787893453.491485:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493494656 00000100:00100000:1.0:1787893453.491516:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493494656 00000100:00100000:1.0:1787893453.491551:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493494400 00000100:00100000:1.0:1787893453.491555:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493494400 00000100:00100000:1.0:1787893453.491567:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493493888 00000100:00100000:1.0:1787893453.491569:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493493888 00000100:00100000:1.0:1787893453.491579:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493494528 00000100:00100000:1.0:1787893453.491591:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493494528 00000100:00100000:1.0:1787893453.491611:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787893453.491617:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493494656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893453.491655:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493494656:12345-0@lo:400:kworker.0 Request processed in 39us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893453.491661:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787893453.491675:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787893453.491681:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493494400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.492295:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893453.493247:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493494144 00000100:00100000:2.0:1787893453.493263:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493494144 00000100:00100000:2.0:1787893453.493326:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493494272 00000100:00100000:2.0:1787893453.493783:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493494272 00000100:00100000:2.0:1787893453.493810:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893453.493822:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493494144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.493907:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493494144:12345-0@lo:400:kworker.0 Request processed in 88us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893453.493915:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893453.493936:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787893453.493941:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493494272:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787893453.493965:0:24270:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787893453.494024:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493494272:12345-0@lo:8:kworker.0 Request processed in 81us (1731us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787893453.494030:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787893453.494064:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493494016 00000100:00100000:2.0:1787893453.494069:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493494016 00000100:00100000:2.0:1787893453.494095:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493493760 00000100:00100000:2.0:1787893453.494107:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493493760 00000100:00100000:2.0:1787893453.494121:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787893453.494127:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493494016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.494934:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493494016:12345-0@lo:400:kworker.0 Request processed in 801us (4170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893453.494945:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787893453.494967:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787893453.494975:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493493760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.495006:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493493760:12345-0@lo:400:kworker.0 Request processed in 33us (4121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893453.495012:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787893453.495054:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787893453.495063:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493493888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.495097:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493493888:12345-0@lo:400:kworker.0 Request processed in 35us (4123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893453.495114:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787893453.495139:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787893453.495147:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493494528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893453.495181:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493494528:12345-0@lo:400:kworker.0 Request processed in 35us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893453.495200:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787893453.495319:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893453.495329:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787893453.495333:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493494272:0@lo:8:kworker.0 00000100:00100000:0.0:1787893453.495871:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493493632 00000100:00100000:0.0:1787893453.495879:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493493632 00000100:00100000:0.0:1787893453.495931:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787893453.495940:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493493632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787893453.495973:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787893453.496035:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493493632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (4765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893453.496052:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893453.496644:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493494400:12345-0@lo:400:kworker.0 Request processed in 4958us (5711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893453.496655:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787893453.496686:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787893453.496692:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893453.496694:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893453.496744:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493494016:0@lo:400:kworker.0 00010000:00080000:1.0:1787893453.496762:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ffb9ed80 x1874741493494656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893453.496773:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493494656:0@lo:400:kworker.0 00010000:00080000:1.0:1787893453.496787:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ffb9d880 x1874741493494144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893453.496795:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493494144:0@lo:400:kworker.0 00000100:00100000:1.0:1787893453.496834:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493493504:0@lo:400:kworker.0 00010000:00080000:1.0:1787893453.496846:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c8505f80 x1874741493493632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893453.496881:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493493632:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787893453.499307:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ffb9d500 x1874741493494400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893453.499332:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493494400:0@lo:400:kworker.0 00010000:00080000:3.0:1787893453.499368:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ffb9f480 x1874741493493888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893453.499377:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493493888:0@lo:400:kworker.0 00010000:00080000:3.0:1787893453.499398:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ffb9c700 x1874741493494528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893453.499406:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493494528:0@lo:400:kworker.0 00000100:00100000:3.0:1787893453.499420:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493493760:0@lo:400:kworker.0 00010000:00010000:2.0:1787893453.880311:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893454.006560:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893454.006591:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493494784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893454.006680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893454.006881:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493494784 00000100:00100000:2.0:1787893454.006892:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493494784 00000100:00100000:2.0:1787893454.006959:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787893454.006971:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493494784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787893454.007012:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787893454.007078:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493494784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893454.007085:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787893454.008233:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493494784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893454.011631:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893454.011662:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493494912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893454.011970:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893454.012077:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493494912 00000100:00100000:3.0:1787893454.012088:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493494912 00000100:00100000:3.0:1787893454.012163:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787893454.012175:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493494912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787893454.012223:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787893454.012281:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493494912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893454.012289:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787893454.012417:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493494912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893454.513576:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893434/real 1787893434] req@ffff9fc9e711c000 x1874741493485184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893454 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893454.513621:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc9e711c000 x1874741493485184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893454 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893454.513643:0:3629:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893434/real 1787893434] req@ffff9fc8c7525f80 x1874741493485312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893454 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893454.513655:0:3629:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc8c7525f80 x1874741493485312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893454 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787893454.513678:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb46800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893454.513697:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893454.513701:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493485184:0@lo:8:kworker.0 00000100:00080000:0.0:1787893454.513708:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7747000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893454.513713:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893454.513716:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493485312:0@lo:8:kworker.0 00000100:00080000:1.0:1787893454.514228:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893454.514234:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787893454.514237:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb46800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893454.514243:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:1.0:1787893454.514249:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787893454.514257:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc9ffb46800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893454.514283:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8506a00 x1874741493495296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893454.514297:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893454.514301:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787893454.514303:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7747000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893454.514306:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:1.0:1787893454.514309:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787893454.514312:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc8c7747000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893454.514326:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8504380 x1874741493495424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893454.514355:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893454.514358:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787893454.514367:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893454.514372:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 697 00000100:00080000:1.0:1787893454.514374:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787893454.514378:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc8c75fc000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:1.0:1787893454.514391:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8504e00 x1874741493495936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893454.514443:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493495680:0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.514548:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.514590:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493496320:0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.514617:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.514640:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787893454.514645:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493495040:0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.514675:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.514703:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493495808:0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.514740:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.514769:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493495168:0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.514792:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.514812:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493496064:0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.514833:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.514850:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787893454.514855:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493495552:0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.514879:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.514893:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493496192:0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.514915:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.514961:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493495680 00000100:00100000:1.0:1787893454.514970:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493495680 00000100:00100000:1.0:1787893454.515018:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493495168 00000100:00100000:1.0:1787893454.515022:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493495168 00000100:00100000:1.0:1787893454.515050:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787893454.515060:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493495680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.515120:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493495680:12345-0@lo:400:kworker.0 Request processed in 61us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893454.515127:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787893454.515145:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787893454.515151:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493495168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.515182:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493495168:12345-0@lo:400:kworker.0 Request processed in 31us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893454.515188:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787893454.515207:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493495040 00000100:00100000:1.0:1787893454.515211:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493495040 00000100:00100000:1.0:1787893454.515237:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787893454.515244:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:3630:x1874741493495040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.515272:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:3630:x1874741493495040:12345-0@lo:400:kworker.0 Request processed in 29us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893454.515278:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787893454.515310:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493496320 00000100:00100000:1.0:1787893454.515314:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493496320 00000100:00100000:1.0:1787893454.515335:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493496064 00000100:00100000:1.0:1787893454.515338:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493496064 00000100:00100000:1.0:1787893454.515346:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493495552 00000100:00100000:1.0:1787893454.515349:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493495552 00000100:00100000:1.0:1787893454.515359:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493496192 00000100:00100000:1.0:1787893454.515361:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493496192 00000100:00100000:1.0:1787893454.515385:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787893454.515390:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493496320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.515421:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493496320:12345-0@lo:400:kworker.0 Request processed in 32us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893454.515427:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787893454.515438:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787893454.515443:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493496064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.515469:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493496064:12345-0@lo:400:kworker.0 Request processed in 25us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893454.515474:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787893454.515485:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787893454.515514:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493495552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.515541:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493495552:12345-0@lo:400:kworker.0 Request processed in 51us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893454.515547:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787893454.515558:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787893454.515563:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493496192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.515588:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493496192:12345-0@lo:400:kworker.0 Request processed in 25us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893454.515594:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787893454.515637:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c8507800 x1874741493495552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893454.515651:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493495552:0@lo:400:kworker.0 00010000:00080000:1.0:1787893454.515662:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9fa529180 x1874741493496192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893454.515683:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493496192:0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.515696:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493495168:0@lo:400:kworker.0 00010000:00080000:1.0:1787893454.515706:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9fa529f80 x1874741493496064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893454.515713:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493496064:0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.515752:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493495296:0@lo:8:kworker.0 00000100:00100000:1.0:1787893454.515780:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.515801:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493495424:0@lo:8:kworker.0 00000100:00100000:1.0:1787893454.515843:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.515860:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493495936:0@lo:8:kworker.0 00000100:00100000:1.0:1787893454.515879:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.515926:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493495040:0@lo:400:kworker.0 00000100:00100000:1.0:1787893454.515941:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493495680:0@lo:400:kworker.0 00010000:00080000:1.0:1787893454.515954:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9fa52b800 x1874741493496320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893454.515964:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493496320:0@lo:400:kworker.0 00000100:00100000:2.0:1787893454.516106:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493495808 00000100:00100000:2.0:1787893454.516111:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493495808 00000100:00100000:2.0:1787893454.516143:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493495296 00000100:00100000:2.0:1787893454.516146:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493495296 00000100:00100000:2.0:1787893454.516155:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493495424 00000100:00100000:2.0:1787893454.516158:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493495424 00000100:00100000:2.0:1787893454.516164:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493495936 00000100:00100000:2.0:1787893454.516167:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493495936 00000100:00100000:2.0:1787893454.516176:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893454.516184:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493495808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893454.516241:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493495808:12345-0@lo:400:kworker.0 Request processed in 58us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893454.516248:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893454.516263:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787893454.516267:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493495296:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787893454.516298:0:24270:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 698 last 0 00000020:00000080:2.0:1787893454.516341:0:24270:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf2876 00002000:00100000:2.0:1787893454.516359:0:24270:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fc8c7798000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787893454.516364:0:24270:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787893454.516367:0:24270:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787893454.516462:0:24270:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787893454.516536:0:24270:0:(import.c:65:import_set_state_nolock()) ffff9fc8c779d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893454.516579:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1874741493495296:12345-0@lo:8:kworker.0 Request processed in 310us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893454.516586:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787893454.516600:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787893454.516603:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493495424:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787893454.516615:0:24270:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787893454.516640:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493495424:12345-0@lo:8:kworker.0 Request processed in 34us (797us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787893454.516646:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787893454.516657:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787893454.516661:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493495936:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787893454.516670:0:24270:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787893454.516695:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3629:x1874741493495936:12345-0@lo:8:kworker.0 Request processed in 32us (814us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787893454.516700:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787893454.516753:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c8506a00 x1874741493495296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787893479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893454.516762:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787893454.516770:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787893454.516784:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787893454.516790:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787893454.516793:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc9ffb46800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787893454.516809:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787893454.516815:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493495296:0@lo:8:kworker.0 00000100:00080000:2.0:1787893454.516832:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7747000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893454.516837:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787893454.516840:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493495424:0@lo:8:kworker.0 00000100:00080000:2.0:1787893454.516849:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893454.516853:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787893454.516856:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493495936:0@lo:8:kworker.0 00000004:00080000:2.0:1787893454.516883:0:22787:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787893454.516956:0:22787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698338464496ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787893454.516964:0:22787:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787893454.517833:0:22788:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1787893454.517863:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22788:1874741493496576:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787893454.517920:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893454.517950:0:22788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d90b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787893454.518220:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493496576 00000100:00100000:0.0:1787893454.518228:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493496576 00000100:00100000:0.0:1787893454.518292:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787893454.518301:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22788:x1874741493496576:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787893454.520413:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493496448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893454.520532:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787893454.520705:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787893454.520758:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c8504a80 x1874741493495808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893454.520776:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493495808:0@lo:400:kworker.0 00000100:00100000:0.0:1787893454.521322:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493496448 00000100:00100000:0.0:1787893454.521332:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493496448 00000100:00100000:0.0:1787893454.521398:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893454.521410:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493496448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787893454.521439:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00002000:00080000:2.0:1787893454.521589:0:24270:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787893454.521598:0:24270:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1787893454.521604:0:24270:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000100:00100000:0.0:1787893454.522240:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493496448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 829us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893454.522250:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787893454.536300:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c8483480 x1874741493496448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893454.536339:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493496448:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1787893454.543407:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.543437:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a33a5b/0x9232577658cf287d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.543458:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.543464:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.543471:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a33a5b/0x9232577658cf287d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.543673:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a33a5b/0x9232577658cf287d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.543687:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a33a5b/0x9232577658cf287d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.543695:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a33a5b/0x9232577658cf287d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.543725:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893454.544283:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893454.544293:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a33a5b/0x9232577658cf287d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.544303:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893454.544308:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a33a5b/0x9232577658cf287d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.544319:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a33a5b/0x9232577658cf287d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.544344:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a33a5b/0x9232577658cf287d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.544351:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a33a5b/0x9232577658cf287d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.544375:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.544377:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.544379:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893454.544649:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.544656:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000073330d/0x9232577658cf2884 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.544667:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.544671:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.544676:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000073330d/0x9232577658cf2884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.544688:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000073330d/0x9232577658cf2884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.544706:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000073330d/0x9232577658cf2884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.544714:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000073330d/0x9232577658cf2884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.544731:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893454.544741:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893454.544746:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000073330d/0x9232577658cf2884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.544753:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893454.544757:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000073330d/0x9232577658cf2884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.544764:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000073330d/0x9232577658cf2884 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.544776:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000073330d/0x9232577658cf2884 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.544784:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000073330d/0x9232577658cf2884 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.544798:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893454.544806:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893454.544807:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893454.546797:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.546815:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000493320f5/0x9232577658cf288b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.546834:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.546839:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.546846:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000493320f5/0x9232577658cf288b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.546861:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000493320f5/0x9232577658cf288b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.546872:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000493320f5/0x9232577658cf288b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.546880:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000493320f5/0x9232577658cf288b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.546905:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893454.548118:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893454.548130:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000493320f5/0x9232577658cf288b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.548143:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893454.548149:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000493320f5/0x9232577658cf288b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.548174:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000493320f5/0x9232577658cf288b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.548198:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000493320f5/0x9232577658cf288b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.548205:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000493320f5/0x9232577658cf288b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.548226:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.548228:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.548230:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893454.548701:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.548710:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf2892 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.548723:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.548727:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.548732:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf2892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.548755:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf2892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.548765:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf2892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.548774:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf2892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.548800:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893454.549099:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893454.549120:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf2892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.549129:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893454.549133:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf2892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.549141:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf2892 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.549155:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf2892 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.549175:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060f5eadb/0x9232577658cf2892 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.549193:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.549195:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.549196:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893454.549452:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.549459:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5bd3932/0x9232577658cf2899 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.549468:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.549472:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.549476:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5bd3932/0x9232577658cf2899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.549486:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5bd3932/0x9232577658cf2899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.549531:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5bd3932/0x9232577658cf2899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.549549:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5bd3932/0x9232577658cf2899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.549567:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893454.549885:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.549892:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c50c1a68/0x9232577658cf28a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.549901:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.549904:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.549908:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c50c1a68/0x9232577658cf28a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.549918:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c50c1a68/0x9232577658cf28a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.549927:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c50c1a68/0x9232577658cf28a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.549934:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c50c1a68/0x9232577658cf28a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.549947:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787893454.553820:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787893454.553841:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5bd3932/0x9232577658cf2899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.553860:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893454.553867:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5bd3932/0x9232577658cf2899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.553881:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5bd3932/0x9232577658cf2899 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.553911:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5bd3932/0x9232577658cf2899 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.553920:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5bd3932/0x9232577658cf2899 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.553957:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893454.553962:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c50c1a68/0x9232577658cf28a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.553993:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893454.553997:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c50c1a68/0x9232577658cf28a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.554004:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c50c1a68/0x9232577658cf28a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.554015:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c50c1a68/0x9232577658cf28a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.554021:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c50c1a68/0x9232577658cf28a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.554047:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.554049:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.554051:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.554062:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893454.554485:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.554705:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e003f40/0x9232577658cf28a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.554730:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.554735:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.554743:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e003f40/0x9232577658cf28a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.554757:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e003f40/0x9232577658cf28a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.554767:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e003f40/0x9232577658cf28a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.554775:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e003f40/0x9232577658cf28a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.554797:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893454.555652:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893454.555662:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e003f40/0x9232577658cf28a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.555673:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893454.555679:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e003f40/0x9232577658cf28a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.555704:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e003f40/0x9232577658cf28a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.555724:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e003f40/0x9232577658cf28a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.555731:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e003f40/0x9232577658cf28a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.555756:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.555758:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.555759:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893454.555916:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.555922:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f12f443/0x9232577658cf28ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.555931:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.555935:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.555941:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f12f443/0x9232577658cf28ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.555953:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f12f443/0x9232577658cf28ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.555979:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f12f443/0x9232577658cf28ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.555986:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f12f443/0x9232577658cf28ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.556052:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893454.556602:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.556608:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf28b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.556619:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.556623:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.556627:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf28b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.556637:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf28b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.556645:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf28b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.556652:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf28b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.557801:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787893454.557815:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f12f443/0x9232577658cf28ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.557829:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893454.557835:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f12f443/0x9232577658cf28ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.557846:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f12f443/0x9232577658cf28ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.557868:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f12f443/0x9232577658cf28ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.557894:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f12f443/0x9232577658cf28ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.557919:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893454.557924:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf28b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.557931:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893454.557934:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf28b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.557943:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf28b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.557954:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf28b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.557962:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.557964:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.557966:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893454.569644:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787893454.569665:0:24270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e659e5a0/0x9232577658cf28b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.570231:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893454.570486:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.570604:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf28bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.570621:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.570626:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.570634:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf28bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.570649:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf28bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.570660:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf28bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.570667:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf28bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.570719:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893454.572577:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.572592:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdb19d19/0x9232577658cf28c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.572624:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.572630:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.572637:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdb19d19/0x9232577658cf28c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.572653:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdb19d19/0x9232577658cf28c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.572664:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdb19d19/0x9232577658cf28c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.572671:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdb19d19/0x9232577658cf28c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787893454.580252:0:22743:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787893454.580352:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787893454.580365:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf28bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.580383:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893454.580407:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf28bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.580422:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf28bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.580451:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf28bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.580459:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef0c62e5/0x9232577658cf28bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.580529:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893454.580535:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdb19d19/0x9232577658cf28c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.580542:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893454.580546:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdb19d19/0x9232577658cf28c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.580554:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdb19d19/0x9232577658cf28c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.580564:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdb19d19/0x9232577658cf28c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.580574:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.580581:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.580584:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893454.585019:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787893454.585048:0:24270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdb19d19/0x9232577658cf28c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787893454.586231:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.586244:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf969c49/0x9232577658cf28ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.586264:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.586270:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.586277:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf969c49/0x9232577658cf28ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.586314:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf969c49/0x9232577658cf28ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.586326:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf969c49/0x9232577658cf28ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.586335:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf969c49/0x9232577658cf28ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.586369:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893454.586970:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893454.586981:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf969c49/0x9232577658cf28ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.586991:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.586998:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf969c49/0x9232577658cf28ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.587008:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf969c49/0x9232577658cf28ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.587044:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf969c49/0x9232577658cf28ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.587053:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf969c49/0x9232577658cf28ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.587081:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.587083:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.587084:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893454.587916:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.587927:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d67fc54a/0x9232577658cf28d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.587942:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.587946:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.587952:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d67fc54a/0x9232577658cf28d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.587966:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d67fc54a/0x9232577658cf28d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.587976:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d67fc54a/0x9232577658cf28d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.588000:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d67fc54a/0x9232577658cf28d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.588027:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893454.588606:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893454.588616:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d67fc54a/0x9232577658cf28d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.588625:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893454.588631:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d67fc54a/0x9232577658cf28d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.588641:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d67fc54a/0x9232577658cf28d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.588658:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d67fc54a/0x9232577658cf28d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.588665:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d67fc54a/0x9232577658cf28d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.588686:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.588688:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.588690:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.590288:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893454.591834:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893454.591849:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac28bc9a/0x9232577658cf28d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.591872:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=698s v=(0 0) 00010000:00010000:1.0:1787893454.591878:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893454.591886:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac28bc9a/0x9232577658cf28d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.591902:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac28bc9a/0x9232577658cf28d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.591915:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac28bc9a/0x9232577658cf28d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.591923:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac28bc9a/0x9232577658cf28d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893454.591997:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787893454.598605:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893454.598623:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf28df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.598646:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=698s v=(0 0) 00010000:00010000:3.0:1787893454.598651:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893454.598659:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf28df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.598696:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf28df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.598708:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf28df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.598718:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf28df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.601059:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893454.601079:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac28bc9a/0x9232577658cf28d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.601134:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.601140:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac28bc9a/0x9232577658cf28d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.601152:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac28bc9a/0x9232577658cf28d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.601180:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac28bc9a/0x9232577658cf28d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.601187:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac28bc9a/0x9232577658cf28d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.602146:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787893454.603954:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893454.603973:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc508940/0x9232577658cf28e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.603995:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=698s v=(0 0) 00010000:00010000:3.0:1787893454.604001:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893454.604009:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc508940/0x9232577658cf28e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.604025:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc508940/0x9232577658cf28e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.604066:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc508940/0x9232577658cf28e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.604093:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc508940/0x9232577658cf28e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.604121:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787893454.605546:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893454.605560:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d993b68e/0x9232577658cf28ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.605577:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=698s v=(0 0) 00010000:00010000:3.0:1787893454.605582:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893454.605588:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d993b68e/0x9232577658cf28ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.605602:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d993b68e/0x9232577658cf28ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.605612:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d993b68e/0x9232577658cf28ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.605620:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d993b68e/0x9232577658cf28ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.605632:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787893454.606407:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787893454.606417:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf28df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606429:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fe00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.606434:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf28df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606444:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf28df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606465:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf28df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606483:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f7df9f3/0x9232577658cf28df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606521:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893454.606525:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc508940/0x9232577658cf28e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606533:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.606536:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc508940/0x9232577658cf28e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606544:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc508940/0x9232577658cf28e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606554:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc508940/0x9232577658cf28e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606561:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc508940/0x9232577658cf28e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606575:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893454.606578:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d993b68e/0x9232577658cf28ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606585:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.606594:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d993b68e/0x9232577658cf28ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606602:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d993b68e/0x9232577658cf28ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606613:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d993b68e/0x9232577658cf28ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606621:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d993b68e/0x9232577658cf28ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.606635:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.606636:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.606638:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.606720:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787893454.607922:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893454.607934:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf28f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.607959:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=698s v=(0 0) 00010000:00010000:3.0:1787893454.607964:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893454.607971:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf28f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.607985:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf28f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.607996:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf28f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.608004:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf28f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.608026:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893454.608606:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893454.608614:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf28f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.608624:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.608629:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf28f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.608640:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf28f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.608667:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf28f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.608683:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e9de250/0x9232577658cf28f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.608705:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.608708:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.608709:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.609833:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.609838:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.609841:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893454.609993:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.610005:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf28fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.610021:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.610026:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.610051:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf28fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.610066:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf28fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.610077:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf28fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.610086:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf28fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.610242:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893454.614809:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.614829:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf2902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.614850:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.614856:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.614863:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf2902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.614880:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf2902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.614890:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf2902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.614919:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf2902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.621697:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893454.621717:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf28fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.621735:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.621741:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf28fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.621754:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf28fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.621784:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf28fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.621793:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf28fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.621832:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893454.621836:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf2902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.621842:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.621845:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf2902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.621853:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf2902 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.621864:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf2902 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.621871:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.621873:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.621875:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.625771:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.634417:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787893454.634437:0:24270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf2902 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893454.639384:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.639402:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a258b848/0x9232577658cf2909 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.639424:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.639429:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.639437:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a258b848/0x9232577658cf2909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.639454:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a258b848/0x9232577658cf2909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.639465:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a258b848/0x9232577658cf2909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.639473:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a258b848/0x9232577658cf2909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.639536:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893454.639748:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893454.639758:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a258b848/0x9232577658cf2909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.639777:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.639782:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a258b848/0x9232577658cf2909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.639804:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a258b848/0x9232577658cf2909 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.639825:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a258b848/0x9232577658cf2909 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.639833:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a258b848/0x9232577658cf2909 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.639853:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.639855:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.639857:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893454.641259:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.641275:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf2910 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.641293:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.641298:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.641304:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf2910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.641318:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf2910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.641329:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf2910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.641338:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf2910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.641404:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893454.643371:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.643387:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf2917 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.643404:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.643417:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.643423:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf2917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.643438:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf2917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.643447:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf2917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.643454:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf2917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.647651:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893454.647670:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf2910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.647687:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.647693:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf2910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.647705:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf2910 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.647733:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf2910 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.647753:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017d550a0/0x9232577658cf2910 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.647943:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893454.647948:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf2917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.647957:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.647960:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf2917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.647968:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf2917 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.647979:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf2917 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.647986:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.647988:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.647990:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.649284:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787893454.649298:0:24270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c35b197/0x9232577658cf2917 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893454.650171:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.650182:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf291e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.650198:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.650203:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.650210:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf291e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.650226:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf291e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.650246:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf291e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.650254:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf291e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.650284:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893454.650691:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893454.650699:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf291e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.650709:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.650721:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf291e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.650732:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf291e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.650752:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf291e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.650760:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f39d8850/0x9232577658cf291e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.650799:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.650801:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.650803:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.651026:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893454.651376:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.651385:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2925 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.651396:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.651400:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.651406:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.651418:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.651428:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.651437:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.651477:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893454.652010:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893454.652018:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.652029:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893454.652046:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.652057:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.652082:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2925 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.652091:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fed994f3/0x9232577658cf2925 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.652124:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.652126:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.652134:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893454.652407:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.652415:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf292c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.652427:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.652431:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.652437:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf292c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.652448:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf292c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.652457:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf292c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.652467:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf292c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.652559:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893454.653051:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.653058:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c13d201/0x9232577658cf2933 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.653068:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.653078:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.653083:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c13d201/0x9232577658cf2933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.653093:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c13d201/0x9232577658cf2933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.653101:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c13d201/0x9232577658cf2933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.653339:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c13d201/0x9232577658cf2933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.653392:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787893454.654590:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.654602:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041b1528f/0x9232577658cf293a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.654619:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.654624:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.654630:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041b1528f/0x9232577658cf293a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.654656:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041b1528f/0x9232577658cf293a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.654668:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041b1528f/0x9232577658cf293a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.654686:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041b1528f/0x9232577658cf293a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.654886:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787893454.654896:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf292c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.654906:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.654912:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf292c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.654922:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf292c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.654948:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf292c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.654965:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003a37e24/0x9232577658cf292c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.654987:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893454.654991:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c13d201/0x9232577658cf2933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.654999:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69ca00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.655002:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c13d201/0x9232577658cf2933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.655010:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c13d201/0x9232577658cf2933 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.655021:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c13d201/0x9232577658cf2933 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.655029:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c13d201/0x9232577658cf2933 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.655056:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893454.655060:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041b1528f/0x9232577658cf293a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.655067:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69d000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893454.655076:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041b1528f/0x9232577658cf293a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.655085:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041b1528f/0x9232577658cf293a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.655097:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041b1528f/0x9232577658cf293a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.655106:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.655108:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893454.655110:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.655449:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.656987:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787893454.657002:0:24270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041b1528f/0x9232577658cf293a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.657082:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787893454.658897:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893454.658912:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3051c2/0x9232577658cf2941 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.658932:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=698s v=(0 0) 00010000:00010000:0.0:1787893454.658937:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893454.658944:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3051c2/0x9232577658cf2941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.658961:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3051c2/0x9232577658cf2941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.658972:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df3051c2/0x9232577658cf2941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.658980:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df3051c2/0x9232577658cf2941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.659011:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893454.659531:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893454.659540:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df3051c2/0x9232577658cf2941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.659550:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893454.659556:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3051c2/0x9232577658cf2941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.659566:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df3051c2/0x9232577658cf2941 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.659587:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df3051c2/0x9232577658cf2941 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.659595:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3051c2/0x9232577658cf2941 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.659629:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.659632:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.659634:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787893454.660920:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893454.660934:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf2948 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.660950:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=698s v=(0 0) 00010000:00010000:0.0:1787893454.660954:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893454.660961:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf2948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.660974:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf2948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.660984:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf2948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.660992:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf2948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893454.661014:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893454.661556:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893454.661565:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf2948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.661576:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893454.661581:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf2948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.661591:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf2948 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.661611:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf2948 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.661620:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001414b08e/0x9232577658cf2948 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.661822:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.661825:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.661827:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893454.662948:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.662960:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aea44c4/0x9232577658cf294f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.662977:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.662981:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.662987:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aea44c4/0x9232577658cf294f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.663001:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aea44c4/0x9232577658cf294f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.663012:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aea44c4/0x9232577658cf294f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.663020:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000aea44c4/0x9232577658cf294f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.664728:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787893454.666945:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893454.666963:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2956 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.666986:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=698s v=(0 0) 00010000:00010000:2.0:1787893454.666991:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893454.666999:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.667016:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.667028:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893454.667049:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.671307:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787893454.671332:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000aea44c4/0x9232577658cf294f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.671364:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69da00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893454.671370:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000aea44c4/0x9232577658cf294f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.671384:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000aea44c4/0x9232577658cf294f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.671413:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000aea44c4/0x9232577658cf294f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.671421:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aea44c4/0x9232577658cf294f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.671447:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893454.671451:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2956 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.671457:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69d800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893454.671461:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2956 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.671468:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2956 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.671478:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2956 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.671522:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.671524:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893454.671527:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893454.673617:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787893454.673637:0:24270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002170d5bd/0x9232577658cf2956 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893454.673920:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787893454.674800:0:24270:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1787893454.674977:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22788:x1874741493496576:12345-0@lo:5:osp-pre-0-0.0 Request processed in 156671us (157051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893454.674996:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893454.682829:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22788:1874741493496576:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787893454.682859:0:22788:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1787893454.683006:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22788:1874741493496704:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787893454.683097:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893454.683149:0:22788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57900 going to sleep for 11 seconds 00000100:00100000:2.0:1787893454.683371:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493496704 00000100:00100000:2.0:1787893454.683379:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493496704 00000100:00100000:2.0:1787893454.683445:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787893454.683455:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22788:x1874741493496704:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787893454.683563:0:24272:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1787893454.712344:0:24267:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1787893454.712423:0:24267:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787893454.712944:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22788:x1874741493496704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 29482us (29839us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787893454.712959:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787893454.713086:0:22788:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1787893454.713097:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22788:1874741493496704:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787893454.713116:0:22788:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1787893454.898222:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787893455.090185:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1787893455.147335:0:25087:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787893455.147341:0:25087:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787893455.147343:0:25087:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787893455.147475:0:25087:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc8c7d94000 00000020:01000004:0.0:1787893455.147648:0:25087:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787893455.147668:0:25087:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787893455.148679:0:25087:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fc8c7733370) 00000020:00000080:0.0:1787893455.148958:0:25087:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787893455.249693:0:25087:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787893455.250672:0:25087:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787893455.251470:0:25087:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787893455.255361:0:25087:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787893455.256048:0:25087:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787893455.256368:0:25087:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787893455.256687:0:25087:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1787893455.264352:0:25087:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787893455.264607:0:25087:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787893455.264622:0:25087:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787893455.264634:0:25087:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9232577658cf2964 00000020:01000004:2.0:1787893455.264641:0:25087:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787893455.264664:0:25087:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.135@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787893455.264668:0:25087:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787893455.264677:0:25087:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787893455.264704:0:25087:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787893455.264708:0:25087:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787893455.280908:0:25087:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.135@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787893455.280956:0:25087:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.135@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787893455.280961:0:25087:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787893455.280963:0:25087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787893455.280965:0:25087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893455.280966:0:25087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893455.280967:0:25087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893455.280968:0:25087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893455.280970:0:25087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787893455.280972:0:25087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893455.280973:0:25087:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787893455.280977:0:25087:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787893455.280980:0:25087:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787893455.280981:0:25087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787893455.280983:0:25087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893455.280984:0:25087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893455.280985:0:25087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893455.280986:0:25087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893455.280987:0:25087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787893455.280988:0:25087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893455.280989:0:25087:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787893455.281019:0:25087:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787893455.281053:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493496832:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787893455.281131:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893455.281696:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893455.281842:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493496832 00000100:00100000:0.0:1787893455.281852:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493496832 00000100:00100000:0.0:1787893455.281913:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787893455.281923:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:25087:x1874741493496832:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787893455.281973:0:22755:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787893455.281977:0:22755:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787893455.281982:0:22755:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787893455.282738:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:25087:x1874741493496832:12345-0@lo:253:mount.lustre.0 Request processed in 814us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893455.282747:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787893455.283228:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493496832:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787893455.283242:0:25087:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787893455.283245:0:25087:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787893455.283246:0:25087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787893455.283248:0:25087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893455.283249:0:25087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893455.283250:0:25087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893455.283251:0:25087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893455.283253:0:25087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787893455.283255:0:25087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893455.283256:0:25087:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787893455.283275:0:25087:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc8c7d94000 from lustre-OST0001 10000000:01000000:1.0:1787893455.283303:0:25087:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787893455.283305:0:25087:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787893455.283313:0:25087:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc9d911cd28 local copy 00010000:00010000:1.0:1787893455.283322:0:25087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893455.283414:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493496960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893455.283454:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893455.283537:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893455.283677:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493496960 00000100:00100000:2.0:1787893455.283683:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493496960 00000100:00100000:2.0:1787893455.283724:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787893455.283734:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+21:25087:x1874741493496960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893455.283809:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+21:25087:x1874741493496960:12345-0@lo:501:mount.lustre.0 Request processed in 76us (354us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787893455.283826:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787893455.283930:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493496960:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787893455.283943:0:25087:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787893455.283961:0:25087:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787893455.283966:0:25087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.283975:0:25087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30000/0x9232577658cf2597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf259e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893455.283999:0:25087:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc8c7d94000 10000000:01000000:0.0:1787893455.284003:0:25087:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787893455.284008:0:25087:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787893455.284011:0:25087:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787893455.284015:0:25087:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787893455.284018:0:25087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787893455.284048:0:25087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf296b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.284067:0:25087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf296b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.284076:0:25087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf296b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893455.284089:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787893455.284128:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.284149:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e72b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893455.284199:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493497088 00000100:00100000:2.0:1787893455.284204:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493497088 00000100:00100000:2.0:1787893455.284235:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787893455.284242:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:25087:x1874741493497088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893455.284249:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893455.284261:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd69c600/0x9232577658cf2972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf296b expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.284281:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd69c600/0x9232577658cf2972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf296b expref: 22 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.284289:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd69c600/0x9232577658cf2972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf296b expref: 22 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.284297:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69c600, rc 0) 00000100:00100000:2.0:1787893455.284323:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+22:25087:x1874741493497088:12345-0@lo:101:mount.lustre.0 Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893455.284328:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787893455.287796:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893455.287826:0:25087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf296b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2972 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.287839:0:25087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf296b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf2972 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893455.289458:0:25087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1787893455.290205:0:25087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787893455.295422:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787893455.295479:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1787893455.295518:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1787893455.295536:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1787893455.295553:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1787893455.295568:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1787893455.295582:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1787893455.295596:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1787893455.295617:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1787893455.295643:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1787893455.295657:0:25087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1787893455.295761:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893455.295828:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.295878:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e7016b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893455.296164:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493497216 00000100:00100000:2.0:1787893455.296172:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493497216 00000100:00100000:2.0:1787893455.296225:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787893455.296235:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+22:25087:x1874741493497216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893455.296379:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+22:25087:x1874741493497216:12345-0@lo:501:mount.lustre.0 Request processed in 144us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893455.296386:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787893455.296517:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893455.296555:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893455.296609:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893455.296635:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57840 going to sleep for 11 seconds 00000100:00100000:2.0:1787893455.296742:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493497344 00000100:00100000:2.0:1787893455.296752:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493497344 00000100:00100000:2.0:1787893455.296780:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787893455.296787:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+22:25087:x1874741493497344:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893455.297917:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+22:25087:x1874741493497344:12345-0@lo:503:mount.lustre.0 Request processed in 1126us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893455.297928:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787893455.298039:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497344:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787893455.298471:0:25087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787893455.298595:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893455.298643:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893455.298682:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57840 going to sleep for 11 seconds 00000100:00100000:3.0:1787893455.298846:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493497472 00000100:00100000:3.0:1787893455.298852:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493497472 00000100:00100000:3.0:1787893455.298890:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787893455.298899:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+22:25087:x1874741493497472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893455.299353:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+22:25087:x1874741493497472:12345-0@lo:502:mount.lustre.0 Request processed in 454us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893455.299361:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787893455.299996:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893455.300246:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787893455.300275:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787893455.300289:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787893455.300302:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787893455.300316:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787893455.300344:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787893455.300359:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787893455.300372:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787893455.300386:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1787893455.300415:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893455.300464:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893455.300743:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493497600 00000100:00100000:2.0:1787893455.300750:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493497600 00000100:00100000:2.0:1787893455.300792:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787893455.300801:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+22:25087:x1874741493497600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893455.303380:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+22:25087:x1874741493497600:12345-0@lo:502:mount.lustre.0 Request processed in 2571us (2907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893455.303393:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787893455.303553:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57840 going to sleep for 11 seconds 00000100:00100000:1.0:1787893455.303756:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893455.303847:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1787893455.303862:0:25087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1787893455.312410:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787893455.312423:0:25091:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787893455.312430:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893455.312432:0:25091:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787893455.312440:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787893455.312456:0:25091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fc8c74c0000) 00000020:00000080:3.0:1787893455.313736:0:25091:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787893455.313758:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787893455.313860:0:25091:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc8c7d94000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787893455.313875:0:25091:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787893455.313884:0:25091:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9232577658cf2980 00010000:00010000:3.0:1787893455.324381:0:25091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1787893455.327138:0:25091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1787893455.331073:0:25091:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1787893455.333142:0:25091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787893455.333155:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893455.334715:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893455.334718:0:25091:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787893455.334726:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893455.334730:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893455.334732:0:25091:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787893455.334736:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787893455.334738:0:25091:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787893455.334742:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893455.334745:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893455.334746:0:25091:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787893455.334749:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893455.334752:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893455.334753:0:25091:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787893455.334757:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787893455.334788:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893455.334791:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893455.334793:0:25091:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787893455.334796:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1787893455.335060:0:25087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787893455.335091:0:25087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787893455.335121:0:25087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf296b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2972 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893455.335133:0:25087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb31400/0x9232577658cf296b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2972 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893455.335141:0:25087:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc8c7d94000 from 1 10000000:01000000:1.0:1787893455.335144:0:25087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787893455.335193:0:25087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893455.335202:0:25087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893455.335212:0:25087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893455.335237:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893455.335304:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893455.335349:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57840 going to sleep for 11 seconds 00000100:00100000:3.0:1787893455.335821:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493497728 00000100:00100000:3.0:1787893455.335829:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493497728 00000100:00100000:3.0:1787893455.335880:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787893455.335891:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+22:25087:x1874741493497728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893455.335903:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893455.335916:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf298e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2987 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.335950:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf298e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2987 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.335959:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf298e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2987 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.335967:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c7c7e000, rc 0) 00000100:00100000:3.0:1787893455.336010:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+23:25087:x1874741493497728:12345-0@lo:101:mount.lustre.0 Request processed in 121us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893455.336017:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787893455.336178:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893455.336193:0:25087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893455.336202:0:25087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787893455.341305:0:25087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1787893455.344126:0:25087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787893455.344419:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787893455.344447:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1787893455.344463:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1787893455.344477:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1787893455.344529:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1787893455.344545:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1787893455.344557:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1787893455.345454:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1787893455.345478:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1787893455.346734:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1787893455.346759:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1787893455.346780:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1787893455.346785:0:25087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1787893455.346882:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893455.346940:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893455.346982:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57480 going to sleep for 11 seconds 00000100:00100000:3.0:1787893455.347214:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493497856 00000100:00100000:3.0:1787893455.347222:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493497856 00000100:00100000:3.0:1787893455.347274:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787893455.347282:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:25087:x1874741493497856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893455.347392:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:25087:x1874741493497856:12345-0@lo:501:mount.lustre.0 Request processed in 110us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893455.347399:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787893455.347796:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893455.347828:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893455.347869:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893455.347931:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57480 going to sleep for 11 seconds 00000100:00100000:0.0:1787893455.354792:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493497984 00000100:00100000:0.0:1787893455.354807:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493497984 00000100:00100000:0.0:1787893455.354911:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787893455.354922:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+23:25087:x1874741493497984:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893455.355105:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+23:25087:x1874741493497984:12345-0@lo:503:mount.lustre.0 Request processed in 184us (7234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893455.355113:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787893455.355221:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493497984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787893455.355690:0:25087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787893455.355774:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893455.355818:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893455.364936:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57840 going to sleep for 11 seconds 00000100:00100000:3.0:1787893455.367821:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493498112 00000100:00100000:3.0:1787893455.367837:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493498112 00000100:00100000:3.0:1787893455.367906:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787893455.367917:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:25087:x1874741493498112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893455.368118:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:25087:x1874741493498112:12345-0@lo:502:mount.lustre.0 Request processed in 202us (12300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893455.368127:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787893455.368308:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498112:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893455.369169:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787893455.369201:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787893455.369213:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787893455.369224:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787893455.369234:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1787893455.369244:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1787893455.369255:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1787893455.369266:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1787893455.369276:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1787893455.369287:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1787893455.369297:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1787893455.369332:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498240:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893455.369384:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893455.369414:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c870a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787893455.369778:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493498240 00000100:00100000:0.0:1787893455.369786:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493498240 00000100:00100000:0.0:1787893455.369835:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787893455.369843:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:25087:x1874741493498240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893455.369970:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:25087:x1874741493498240:12345-0@lo:502:mount.lustre.0 Request processed in 127us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893455.369978:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787893455.370050:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787893455.370120:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1787893455.370130:0:25087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787893455.371872:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893455.371884:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893455.371886:0:25095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787893455.371892:0:25095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc8c7d94000 00000020:00000080:0.0:1787893455.371894:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893455.371901:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893455.371912:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893455.371914:0:25095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787893455.371918:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893455.371920:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893455.371921:0:25095:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787893455.371924:0:25095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc8c7d94000 00000020:00000080:0.0:1787893455.371927:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893455.371989:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893455.371993:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893455.371994:0:25095:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787893455.371997:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893455.371999:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893455.372000:0:25095:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787893455.372004:0:25095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc8c7d94000 00000020:00000080:0.0:1787893455.372006:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893455.372023:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893455.372036:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893455.372038:0:25095:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787893455.372040:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893455.372042:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893455.372043:0:25095:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787893455.372046:0:25095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc8c7d94000 00000020:00000080:0.0:1787893455.372048:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893455.372070:0:25095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893455.372073:0:25095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893455.372074:0:25095:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787893455.372077:0:25095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787893455.385283:0:25087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787893455.385338:0:25087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787893455.385364:0:25087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893455.385379:0:25087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893455.385444:0:25087:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787893455.385448:0:25087:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc8c7d94000 10000000:01000000:1.0:1787893455.385451:0:25087:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc8c7d94000 10000000:01000000:1.0:1787893455.385455:0:25087:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787893455.385466:0:25087:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc8c7d94000 from 1 10000000:01000000:1.0:1787893455.385469:0:25087:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787893455.385526:0:25087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729800/0x9232577658cf2995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893455.385536:0:25087:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729800/0x9232577658cf2995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893455.385548:0:25087:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729800/0x9232577658cf2995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893455.385586:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893455.385653:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893455.385691:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57180 going to sleep for 11 seconds 00000100:00100000:0.0:1787893455.385905:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493498368 00000100:00100000:0.0:1787893455.385914:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493498368 00000100:00100000:0.0:1787893455.385972:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787893455.385985:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:25087:x1874741493498368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893455.385998:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893455.386017:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31600/0x9232577658cf299c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2995 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.386051:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31600/0x9232577658cf299c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2995 expref: 24 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.386065:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31600/0x9232577658cf299c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2995 expref: 24 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.386074:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31600, rc 0) 00000100:00100000:0.0:1787893455.386121:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493498368:12345-0@lo:101:mount.lustre.0 Request processed in 139us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893455.386128:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787893455.386178:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893455.386191:0:25087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729800/0x9232577658cf2995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf299c expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.386199:0:25087:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729800/0x9232577658cf2995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf299c expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893455.409054:0:25087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787893455.409820:0:25087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787893455.411241:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787893455.411422:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787893455.411446:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787893455.411461:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787893455.411474:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1787893455.411487:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1787893455.411541:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1787893455.411558:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1787893455.411583:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787893455.411596:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1787893455.411610:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1787893455.411623:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1787893455.411634:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1787893455.411645:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1787893455.411659:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1787893455.411673:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1787893455.411686:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1787893455.411699:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1787893455.411709:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1787893455.411721:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1787893455.411750:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1787893455.411769:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1787893455.411780:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1787893455.411791:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1787893455.411804:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1787893455.411815:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1787893455.411827:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1787893455.411839:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1787893455.411850:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1787893455.411862:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1787893455.411872:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1787893455.411883:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1787893455.411894:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1787893455.411910:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1787893455.411920:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1787893455.411931:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1787893455.411955:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1787893455.411969:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1787893455.411979:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1787893455.411990:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1787893455.412005:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1787893455.412038:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1787893455.412052:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1787893455.413552:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1787893455.413588:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1787893455.413601:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1787893455.413613:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1787893455.413626:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1787893455.413820:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1787893455.413840:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1787893455.413855:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1787893455.413860:0:25087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1787893455.413966:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893455.414068:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.414127:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c72b2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893455.414581:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493498496 00000100:00100000:1.0:1787893455.414589:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493498496 00000100:00100000:1.0:1787893455.414640:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787893455.414651:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493498496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893455.414780:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493498496:12345-0@lo:501:mount.lustre.0 Request processed in 131us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893455.414788:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787893455.415048:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893455.415143:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893455.415188:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.415230:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c72b2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893455.416960:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493498624 00000100:00100000:3.0:1787893455.416971:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493498624 00000100:00100000:3.0:1787893455.417081:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787893455.417091:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493498624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893455.417238:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493498624:12345-0@lo:503:mount.lustre.0 Request processed in 148us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893455.417246:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787893455.417469:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498624:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787893455.417926:0:25087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787893455.418013:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893455.418067:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893455.418103:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c67dce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787893455.418351:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493498752 00000100:00100000:1.0:1787893455.418358:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493498752 00000100:00100000:1.0:1787893455.418410:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787893455.418418:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493498752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893455.418544:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493498752:12345-0@lo:502:mount.lustre.0 Request processed in 126us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893455.418551:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787893455.418808:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893455.418985:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787893455.419010:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787893455.419035:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787893455.419051:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787893455.419065:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787893455.419078:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787893455.419091:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787893455.419102:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787893455.419116:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787893455.419130:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787893455.419142:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787893455.419166:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787893455.419179:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787893455.419190:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787893455.419201:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787893455.419214:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787893455.419224:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787893455.419234:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787893455.419246:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787893455.419258:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787893455.419268:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787893455.419278:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787893455.419288:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787893455.419299:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787893455.419322:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787893455.419334:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787893455.419345:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787893455.419365:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787893455.419377:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787893455.419388:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787893455.419402:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787893455.419418:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787893455.419432:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787893455.419443:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787893455.419454:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787893455.419467:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787893455.419888:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787893455.419913:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787893455.419928:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787893455.419944:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787893455.419957:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787893455.419972:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787893455.419987:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787893455.420017:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787893455.420052:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787893455.420069:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787893455.420081:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787893455.420094:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787893455.420141:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893455.420201:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893455.420285:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c67dce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787893455.421846:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493498880 00000100:00100000:1.0:1787893455.421860:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493498880 00000100:00100000:1.0:1787893455.421959:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787893455.421970:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493498880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893455.422139:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493498880:12345-0@lo:502:mount.lustre.0 Request processed in 171us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893455.422147:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787893455.422246:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493498880:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893455.422452:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787893455.422480:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787893455.422538:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493499008:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893455.422584:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893455.431773:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893455.432769:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493499008 00000100:00100000:2.0:1787893455.432781:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493499008 00000100:00100000:1.0:1787893455.434683:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787893455.434699:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493499008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893455.434842:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493499008:12345-0@lo:502:mount.lustre.0 Request processed in 149us (12259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893455.434848:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787893455.434869:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493499008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893455.434951:0:25087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1787893455.434968:0:25087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787893455.438427:0:25101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787893455.438446:0:25101:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fc8c77319b8) 00000020:00000080:0.0:1787893455.438472:0:25101:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787893455.438661:0:25101:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc8c7d94000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787893455.438665:0:25101:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc8c7d94000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787893455.438667:0:25101:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc8c7d94000 3 00010000:00080000:0.0:1787893455.438705:0:25101:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c5c29000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787893455.443265:0:25101:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787893455.443634:0:25101:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787893455.443679:0:25101:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787893455.443693:0:25101:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9232577658cf29aa 00000100:00080000:0.0:1787893455.443710:0:25101:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787893455.443716:0:25101:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc8c5c29000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893455.443752:0:25101:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c8480a80 x1874741493499136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787893455.443781:0:25101:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787893455.444108:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893455.444113:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787893455.444115:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7747000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893455.444120:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 698 00000100:00080000:0.0:1787893455.444124:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787893455.444128:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc8c7747000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893455.444154:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9ffb9c380 x1874741493499520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787893455.444195:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893455.444198:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787893455.444200:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893455.444204:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 698 00000100:00080000:0.0:1787893455.444206:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787893455.444210:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc8c75fc000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893455.444222:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9ffb9ce00 x1874741493500032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893455.444264:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493499264:0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.444332:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.444380:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493499904:0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.444419:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.444443:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787893455.444450:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493499392:0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.444474:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.444522:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493500160:0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.444548:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.444579:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493499648:0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.444602:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.444625:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493500288:0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.444646:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.444665:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787893455.444671:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493499776:0@lo:400:kworker.0 00000100:00100000:1.0:1787893455.444704:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493499904 00000100:00100000:0.0:1787893455.444707:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893455.444713:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493499904 00000100:00100000:0.0:1787893455.444730:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493500416:0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.444762:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893455.444771:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493499392 00000100:00100000:1.0:1787893455.444776:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493499392 00000100:00100000:0.0:1787893455.444796:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493499264 00000100:00100000:1.0:1787893455.444801:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893455.444802:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493499264 00000100:00100000:1.0:1787893455.444813:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493499904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.444835:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493499776 00000100:00100000:0.0:1787893455.444839:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493499776 00000100:00100000:0.0:1787893455.444857:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787893455.444865:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493499264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893455.444877:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493499904:12345-0@lo:400:kworker.0 Request processed in 66us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893455.444885:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893455.444908:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493499264:12345-0@lo:400:kworker.0 Request processed in 42us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893455.444913:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893455.444921:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787893455.444926:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493499392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.444940:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787893455.444949:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493499776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893455.444966:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493499392:12345-0@lo:400:kworker.0 Request processed in 42us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893455.444974:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893455.444998:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493499776:12345-0@lo:400:kworker.0 Request processed in 49us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893455.445006:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787893455.445010:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493499136:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787893455.445047:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493500160 00000100:00100000:0.0:1787893455.445051:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493500160 00000100:00100000:1.0:1787893455.445056:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.445078:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493499648 00000100:00100000:0.0:1787893455.445082:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493499648 00000100:00100000:1.0:1787893455.445089:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493499520:0@lo:8:kworker.0 00000100:00100000:0.0:1787893455.445095:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493500288 00000100:00100000:0.0:1787893455.445099:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493500288 00000100:00100000:0.0:1787893455.445119:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493500416 00000100:00100000:1.0:1787893455.445120:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.445124:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493500416 00000100:00100000:0.0:1787893455.445144:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493499136 00000100:00100000:1.0:1787893455.445145:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493500032:0@lo:8:kworker.0 00000100:00100000:0.0:1787893455.445149:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493499136 00000100:00100000:0.0:1787893455.445166:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787893455.445174:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493500160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893455.445179:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787893455.445213:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893455.445218:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893455.445221:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893455.445222:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493500160:12345-0@lo:400:kworker.0 Request processed in 49us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893455.445231:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787893455.445232:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493499520 00000100:00100000:1.0:1787893455.445237:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493499520 00000100:00100000:0.0:1787893455.445250:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787893455.445254:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493500032 00000100:00100000:0.0:1787893455.445259:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493499648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893455.445260:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493500032 00000100:00100000:1.0:1787893455.445278:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893455.445285:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1874741493499520:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787893455.445294:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493499648:12345-0@lo:400:kworker.0 Request processed in 37us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893455.445300:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787893455.445315:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787893455.445322:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493500288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893455.445342:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1874741493499520:12345-0@lo:8:kworker.0 Request processed in 55us (223us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787893455.445350:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787893455.445358:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493500288:12345-0@lo:400:kworker.0 Request processed in 36us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893455.445367:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787893455.445368:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787893455.445376:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1874741493500032:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787893455.445394:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787893455.445404:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493500416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893455.445415:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1874741493500032:12345-0@lo:8:kworker.0 Request processed in 38us (238us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787893455.445422:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787893455.445443:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493500416:12345-0@lo:400:kworker.0 Request processed in 41us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893455.445450:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787893455.445459:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1787893455.445466:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787893455.445468:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7747000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1787893455.445473:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493499136:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787893455.445477:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00010000:00080000:0.0:1787893455.445519:0:22763:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:0.0:1787893455.445549:0:22763:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9232577658cf29b1 00000004:00100000:0.0:1787893455.445564:0:22763:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787893455.445593:0:22763:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5c2e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893455.445594:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493499520:0@lo:8:kworker.0 00000100:00100000:1.0:1787893455.445620:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787893455.445625:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893455.445629:0:3629:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787893455.445633:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493500032:0@lo:8:kworker.0 00000100:00100000:0.0:1787893455.445639:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1874741493499136:12345-0@lo:38:llog_process_th.0 Request processed in 164us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893455.445649:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787893455.445666:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c8480a80 x1874741493499136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893455.445676:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787893455.445681:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1787893455.445688:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787893455.445693:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787893455.445696:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5c29000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787893455.445697:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493499776:0@lo:400:kworker.0 00000100:00100000:1.0:1787893455.445704:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3629:1874741493499136:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787893455.445716:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ffb9dc00 x1874741493500416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893455.445726:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493500416:0@lo:400:kworker.0 00010000:00080000:0.0:1787893455.445739:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ffb9c700 x1874741493499648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893455.445747:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493499648:0@lo:400:kworker.0 00010000:00080000:0.0:1787893455.445756:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ffb9ed80 x1874741493500288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893455.445762:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493500288:0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.445807:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493499392:0@lo:400:kworker.0 00010000:00080000:0.0:1787893455.445816:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc9ffb9d880 x1874741493500160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893455.445824:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493500160:0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.445833:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493499264:0@lo:400:kworker.0 00000100:00100000:0.0:1787893455.445844:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493499904:0@lo:400:kworker.0 00000020:01000004:0.0:1787893455.445959:0:25101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787893455.445986:0:25101:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9fc8c5f83370) 00000020:00000080:0.0:1787893455.446004:0:25101:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787893455.446088:0:25101:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc8c7d94000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787893455.446093:0:25101:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc8c7d94000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787893455.446095:0:25101:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc8c7d94000 3 00010000:00080000:0.0:1787893455.446119:0:25101:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc8c5c2c800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.135@tcp at head 00010000:00010000:0.0:1787893455.453280:0:25101:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787893455.453597:0:25101:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787893455.453639:0:25101:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787893455.453652:0:25101:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9232577658cf29bf 00000100:00080000:0.0:1787893455.453662:0:25101:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787893455.453666:0:25101:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9fc8c5c2c800 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:0.0:1787893455.453697:0:25101:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c7788000 x1874741493500544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893455.453727:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1874741493500544:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787893455.453788:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.453839:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493500544 00000100:00100000:0.0:1787893455.453845:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493500544 00000100:00100000:0.0:1787893455.453878:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787893455.453885:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3629:x1874741493500544:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787893455.453907:0:22763:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:0.0:1787893455.453934:0:22763:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9232577658cf29c6 00000004:00100000:0.0:1787893455.453949:0:22763:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787893455.453975:0:22763:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5c2e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893455.454020:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1874741493500544:12345-0@lo:38:llog_process_th.0 Request processed in 134us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893455.454037:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787893455.454072:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc8c7788000 x1874741493500544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893455.454081:0:3629:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787893455.454088:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787893455.454095:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787893455.454098:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787893455.454100:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c5c2c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787893455.454106:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3629:1874741493500544:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787893455.454122:0:25101:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1787893455.458096:0:25101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1787893455.458176:0:25087:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787893455.458216:0:25087:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787893455.458235:0:25087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729800/0x9232577658cf2995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf299c expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.458246:0:25087:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9dd729800/0x9232577658cf2995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf299c expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787893455.458331:0:25087:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787893455.458334:0:25087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787893455.458336:0:25087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893455.458337:0:25087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893455.458339:0:25087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893455.458341:0:25087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893455.458342:0:25087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787893455.458345:0:25087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893455.458346:0:25087:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787893455.458350:0:25087:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787893455.458352:0:25087:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787893455.458354:0:25087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787893455.458355:0:25087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893455.458356:0:25087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893455.458357:0:25087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893455.458358:0:25087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893455.458359:0:25087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787893455.458360:0:25087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893455.458361:0:25087:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787893455.458389:0:25087:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787893455.458409:0:25087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493500672:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787893455.458479:0:25087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893455.458546:0:25087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c395c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893455.458569:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493500672 00000100:00100000:0.0:1787893455.458576:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493500672 00000100:00100000:0.0:1787893455.458622:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787893455.458632:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:25087:x1874741493500672:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787893455.458660:0:22757:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787893455.458677:0:22757:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787893455.485613:0:22757:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787893455.485641:0:22757:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787893455.486519:0:22779:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787893455.486528:0:22779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787893455.486555:0:22779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.486575:0:22779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c67e1600/0x9232577658cf285a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2853 expref: 24 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.486584:0:22779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf2868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2861 expref: 24 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.486592:0:22779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.486655:0:22779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf2868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf2861 expref: 24 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.486669:0:22779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf2868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf2861 expref: 24 pid: 22758 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893455.486686:0:22779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493500800:0@lo:104: 00000100:00100000:3.0:1787893455.486752:0:22779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787893455.486808:0:22779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c67e1600/0x9232577658cf285a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf2853 expref: 24 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.486817:0:22779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c67e1600/0x9232577658cf285a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf2853 expref: 24 pid: 22757 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893455.486825:0:22779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493500928:0@lo:104: 00000100:00100000:3.0:1787893455.486848:0:22779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893455.486872:0:22779:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d8c5d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787893455.486995:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493500800 00000100:00100000:0.0:1787893455.487003:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493500800 00000100:00100000:0.0:1787893455.487071:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493500928 00000100:00100000:0.0:1787893455.487075:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493500928 00000100:00100000:2.0:1787893455.487102:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787893455.487116:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+4:22779:x1874741493500800:12345-0@lo:104: 00010000:00010000:2.0:1787893455.487139:0:22746:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.487197:0:22746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787893455.487204:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+4:22779:x1874741493500800:12345-0@lo:104: Request processed in 91us (452us total) trans 0 rc 0/0 00010000:00010000:3.0:1787893455.487216:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893455.487223:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.487231:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1000 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:3.0:1787893455.487235:0:22752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.487243:0:22752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893455.487250:0:22752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893455.487263:0:22752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787893455.487298:0:22752:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.487304:0:22752:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893455.487335:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.487342:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1000/0x9232577658cf2861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf2868 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.487367:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893455.487369:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893455.487371:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893455.487776:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493501056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893455.487812:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893455.488775:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493501056 00000100:00100000:3.0:1787893455.488785:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493501056 00010000:00010000:3.0:1787893455.488822:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf2868 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2861 expref: 25 pid: 22758 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893455.488863:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893455.488873:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+25:3632:x1874741493501056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893455.488888:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893455.488894:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf2868 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2861 expref: 25 pid: 22758 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.488907:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf2868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf2861 expref: 25 pid: 22758 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.488927:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893455.489005:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+25:3632:x1874741493501056:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893455.489012:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787893455.489241:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493501056:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893455.489995:0:22779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb31c00/0x9232577658cf2868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf2861 expref: 24 pid: 22758 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893455.490012:0:22779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493500800:0@lo:104: 00000100:00100000:2.0:1787893455.493745:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893455.493869:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787893455.493889:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+3:22779:x1874741493500928:12345-0@lo:104: 00010000:00010000:3.0:1787893455.493908:0:22746:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893455.494036:0:22746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787893455.494042:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:afca6d2b-351c-4adb-95b2-d9dd13744042+3:22779:x1874741493500928:12345-0@lo:104: Request processed in 165us (7194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893455.494050:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787893455.494072:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893455.494081:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.494089:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1400 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787893455.494093:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.494101:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893455.494108:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893455.494113:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787893455.494159:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.494165:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893455.494189:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.494197:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1400/0x9232577658cf2853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf285a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893455.494215:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893455.494217:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893455.494219:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893455.494235:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afca6d2b-351c-4adb-95b2-d9dd13744042:3633:1874741493501184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893455.494249:0:22779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22779:1874741493500928:0@lo:104: 00010000:00010000:2.0:1787893455.494280:0:22779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893455.494297:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893455.494548:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493501184 00000100:00100000:2.0:1787893455.494555:0:23919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493501184 00010000:00010000:2.0:1787893455.494580:0:23919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c67e1600/0x9232577658cf285a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2853 expref: 24 pid: 22757 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893455.494607:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787893455.494624:0:23919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afca6d2b-351c-4adb-95b2-d9dd13744042+24:3633:x1874741493501184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893455.494634:0:23919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893455.494640:0:23919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c67e1600/0x9232577658cf285a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2853 expref: 24 pid: 22757 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494651:0:23919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c67e1600/0x9232577658cf285a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf2853 expref: 24 pid: 22757 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494665:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c67e1600/0x9232577658cf285a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf2853 expref: 24 pid: 22757 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494679:0:23919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494694:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787893455.494709:0:23919:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017661601s 00010000:00010000:2.0:1787893455.494714:0:23919:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494722:0:23919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494727:0:23919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494732:0:23919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494736:0:23919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7ec00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893455.494740:0:23919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494746:0:23919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494759:0:23919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494769:0:23919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893455.494811:0:23919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afca6d2b-351c-4adb-95b2-d9dd13744042+23:3633:x1874741493501184:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893455.494818:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787893455.494824:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afca6d2b-351c-4adb-95b2-d9dd13744042:3633:1874741493501184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893455.494857:0:22779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494866:0:22779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893455.494879:0:22779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c7c7ec00/0x9232577658cf29cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893455.495867:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+22:25087:x1874741493500672:12345-0@lo:253:mount.lustre.0 Request processed in 37232us (37384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893455.495879:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787893455.504400:0:25087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:afca6d2b-351c-4adb-95b2-d9dd13744042:25087:1874741493500672:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787893455.504424:0:25087:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787893455.504427:0:25087:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787893455.504429:0:25087:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787893455.504430:0:25087:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893455.504431:0:25087:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893455.504433:0:25087:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893455.504434:0:25087:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893455.504436:0:25087:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787893455.504438:0:25087:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893455.504439:0:25087:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787893455.504457:0:25087:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1787893455.510433:0:25087:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1787893455.515038:0:25087:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787893455.515047:0:25087:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787893455.515087:0:25087:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787893455.515133:0:25087:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.135@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787893455.515150:0:25087:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787893455.515170:0:25087:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787893455.516037:0:25087:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787893455.516286:0:25087:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787893455.921836:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787893456.536990:0:25153:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787893456.537903:0:25153:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787893456.886378:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787893456.886386:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9ffc1a000 from 14 10000000:01000000:2.0:1787893456.886391:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787893456.890239:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf29d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893456.890260:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf29d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893456.890276:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf29d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893456.890307:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493501312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787893456.890402:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893456.890442:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1ea6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787893456.890520:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493501312 00000100:00100000:0.0:1787893456.890528:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493501312 00000100:00100000:0.0:1787893456.890579:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787893456.890589:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+22:22761:x1874741493501312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893456.890602:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893456.890618:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf29db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf29d4 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893456.890654:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf29db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf29d4 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893456.890664:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31e00/0x9232577658cf29db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf29d4 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893456.890674:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31e00, rc 0) 00000100:00100000:0.0:1787893456.890718:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+23:22761:x1874741493501312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893456.890725:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787893456.890831:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493501312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893456.890845:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf29d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf29db expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893456.890855:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf29d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf29db expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893456.890909:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493501440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787893456.890940:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893456.890959:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d1ea6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787893456.891019:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493501440 00000100:00100000:0.0:1787893456.891024:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493501440 00000100:00100000:0.0:1787893456.891058:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787893456.891066:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:22761:x1874741493501440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787893456.891079:0:22757:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787893456.891095:0:22757:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787893456.891098:0:22757:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787893456.891175:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:22761:x1874741493501440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893456.891182:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787893456.891210:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493501440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787893456.891265:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787893456.891273:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf29d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf29db expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893456.891281:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7ec00/0x9232577658cf29d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf29db expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893456.891296:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787893456.891299:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc9c425c800 from 14 10000000:01000000:0.0:1787893456.891302:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787893456.891319:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30a00/0x9232577658cf29e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893456.891326:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30a00/0x9232577658cf29e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893456.891334:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30a00/0x9232577658cf29e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893456.891347:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493501568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787893456.891371:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893456.891384:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d028c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893456.891396:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493501568 00000100:00100000:0.0:1787893456.891400:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493501568 00000100:00100000:0.0:1787893456.891417:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787893456.891423:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:22761:x1874741493501568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893456.891430:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893456.891437:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9edb31a00/0x9232577658cf29e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf29e2 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893456.891450:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9edb31a00/0x9232577658cf29e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf29e2 expref: 24 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893456.891457:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9edb31a00/0x9232577658cf29e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf29e2 expref: 24 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893456.891473:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9edb31a00, rc 0) 00000100:00100000:0.0:1787893456.891524:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:22761:x1874741493501568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893456.891530:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787893456.891561:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493501568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893456.891572:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30a00/0x9232577658cf29e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf29e9 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893456.891580:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30a00/0x9232577658cf29e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf29e9 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893456.891615:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493501696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787893456.891643:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893456.891666:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d028c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893456.891713:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493501696 00000100:00100000:2.0:1787893456.891720:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493501696 00000100:00100000:2.0:1787893456.891754:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787893456.891760:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:22761:x1874741493501696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787893456.891770:0:22757:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787893456.891784:0:22757:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787893456.891787:0:22757:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1787893456.891857:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:22761:x1874741493501696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893456.891864:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787893456.891892:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493501696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787893456.891929:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787893456.891935:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30a00/0x9232577658cf29e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf29e9 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893456.891942:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9edb30a00/0x9232577658cf29e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf29e9 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893456.948810:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893457.969668:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893458.609873:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893458.609899:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493501824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893458.610057:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893458.610667:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493501824 00000100:00100000:1.0:1787893458.610677:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493501824 00000100:00100000:1.0:1787893458.610754:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787893458.610764:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493501824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787893458.610795:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787893458.610854:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493501824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893458.610875:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787893458.611332:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893458.613332:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493501824:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787893458.993889:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893459.125284:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893459.125308:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493501952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893459.125375:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893459.125424:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493501952 00000100:00100000:0.0:1787893459.125431:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493501952 00000100:00100000:0.0:1787893459.125474:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787893459.125482:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493501952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893459.125531:0:23786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787893459.125576:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493501952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893459.125609:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787893459.125656:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493501952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893459.128348:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893459.128370:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493502080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893459.128427:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893459.128799:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493502080 00000100:00100000:1.0:1787893459.128807:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493502080 00000100:00100000:1.0:1787893459.128848:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787893459.128857:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493502080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893459.128886:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787893459.128939:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493502080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893459.128946:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787893459.129025:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493502080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893459.634927:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493502208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893459.635017:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893459.635580:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493502208 00000100:00100000:1.0:1787893459.635590:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493502208 00000100:00100000:1.0:1787893459.635655:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787893459.635665:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493502208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893459.635693:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1787893459.635711:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893459.635745:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493502208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893459.635752:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787893459.635769:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493502208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787893460.019478:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893460.668094:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493502336:0@lo:400:kworker.0 00000100:00100000:3.0:1787893460.668173:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893460.674305:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893460.674331:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493502464:0@lo:400:kworker.0 00000100:00100000:3.0:1787893460.674425:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893460.674512:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493502336 00000100:00100000:3.0:1787893460.674520:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493502336 00000100:00100000:3.0:1787893460.674573:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787893460.674582:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:3630:x1874741493502336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893460.674635:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:3630:x1874741493502336:12345-0@lo:400:kworker.0 Request processed in 54us (6462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893460.674644:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787893460.674682:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493502464 00000100:00100000:3.0:1787893460.674685:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493502464 00000100:00100000:3.0:1787893460.674712:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787893460.674719:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493502464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893460.674753:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493502464:12345-0@lo:400:kworker.0 Request processed in 35us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893460.674760:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787893460.674803:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493502464:0@lo:400:kworker.0 00000100:00100000:3.0:1787893460.674813:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:afca6d2b-351c-4adb-95b2-d9dd13744042:3630:1874741493502336:0@lo:400:kworker.0 00000100:00080000:2.0:1787893460.678376:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893460.678382:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787893460.678386:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7747000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893460.678396:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc8c7747000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893460.678418:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc9c3e6f100 x1874741493502720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893460.678456:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893460.678459:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787893460.678460:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893460.678465:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc8c75fc000 using connection 192.168.202.135@tcp/0@lo 00000100:00100000:2.0:1787893460.678476:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc8c67aa300 x1874741493503232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893460.678618:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493502592:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.678678:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.678709:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493503360:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.678732:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.678747:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493503872:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.678768:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.678790:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787893460.678795:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493502848:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.678816:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.678832:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493503488:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.678865:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.678895:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493502720:0@lo:8:kworker.0 00000100:00100000:2.0:1787893460.678917:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.678932:0:3629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493503232:0@lo:8:kworker.0 00000100:00100000:2.0:1787893460.678949:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.678993:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493502592 00000100:00100000:2.0:1787893460.679000:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493502592 00000100:00100000:2.0:1787893460.679038:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493502720 00000100:00100000:2.0:1787893460.679041:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493502720 00000100:00100000:2.0:1787893460.679048:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493503232 00000100:00100000:2.0:1787893460.679050:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493503232 00000100:00100000:2.0:1787893460.679060:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893460.679069:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493502592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.679118:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493502592:12345-0@lo:400:kworker.0 Request processed in 50us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893460.679125:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893460.679141:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787893460.679145:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1874741493502720:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787893460.679170:0:24272:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:2.0:1787893460.679194:0:24272:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9232577658cf29f0 00002000:00100000:2.0:1787893460.679208:0:24272:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fc9d9099000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787893460.679213:0:24272:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787893460.679215:0:24272:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787893460.679373:0:24272:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787893460.679394:0:24272:0:(import.c:65:import_set_state_nolock()) ffff9fc9d9098000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893460.679430:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1874741493502720:12345-0@lo:8:kworker.0 Request processed in 284us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893460.679444:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787893460.679468:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787893460.679472:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3629:x1874741493503232:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787893460.679486:0:24272:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 704 last 0 00000020:00000080:2.0:1787893460.679526:0:24272:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9232577658cf29f7 00002000:00100000:2.0:1787893460.679532:0:24272:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9fc9d909c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787893460.679535:0:24272:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787893460.679537:0:24272:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787893460.679558:0:24272:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787893460.679570:0:24272:0:(import.c:65:import_set_state_nolock()) ffff9fc9d909f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893460.679598:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3629:x1874741493503232:12345-0@lo:8:kworker.0 Request processed in 124us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893460.679604:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787893460.679626:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493503360 00000100:00100000:2.0:1787893460.679630:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493503360 00000100:00100000:2.0:1787893460.679647:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493503872 00000100:00100000:2.0:1787893460.679650:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493503872 00000100:00100000:2.0:1787893460.679672:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493502848 00000100:00100000:2.0:1787893460.679674:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493502848 00000100:00100000:2.0:1787893460.679684:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493503488 00000100:00100000:2.0:1787893460.679686:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493503488 00000100:00100000:2.0:1787893460.679701:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787893460.679707:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493503360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.679738:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1874741493503360:12345-0@lo:400:kworker.0 Request processed in 31us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893460.679744:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787893460.679755:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787893460.679768:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493503872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.679797:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3632:x1874741493503872:12345-0@lo:400:kworker.0 Request processed in 30us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893460.679803:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787893460.679814:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787893460.679821:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493502848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.679846:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493502848:12345-0@lo:400:kworker.0 Request processed in 26us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893460.679852:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787893460.679864:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787893460.679870:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493503488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.679912:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493503488:12345-0@lo:400:kworker.0 Request processed in 42us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893460.679918:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787893460.679948:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893460.679952:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787893460.679988:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67a8e00 x1874741493502848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893460.680002:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493502848:0@lo:400:kworker.0 00010000:00080000:2.0:1787893460.680014:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67a8700 x1874741493503488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893460.680022:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493503488:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.680032:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493502592:0@lo:400:kworker.0 00010000:00080000:2.0:1787893460.680040:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67a9880 x1874741493503360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893460.680055:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3632:1874741493503360:0@lo:400:kworker.0 00010000:00080000:2.0:1787893460.680067:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67a9180 x1874741493503872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893460.680075:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3632:1874741493503872:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.680103:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493503104:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.680130:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.680151:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493503744:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.680174:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.680191:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787893460.680197:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493502976:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.680220:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.680238:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493503616:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.680257:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.680280:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493502976 00000100:00100000:2.0:1787893460.680284:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493502976 00000100:00100000:2.0:1787893460.680313:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787893460.680320:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493502976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.680356:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493502976:12345-0@lo:400:kworker.0 Request processed in 36us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893460.680361:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787893460.680376:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493503744 00000100:00100000:2.0:1787893460.680379:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493503744 00000100:00100000:2.0:1787893460.680403:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493503616 00000100:00100000:2.0:1787893460.680406:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493503616 00000100:00100000:2.0:1787893460.680434:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787893460.680440:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493503744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.680469:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493503744:12345-0@lo:400:kworker.0 Request processed in 29us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893460.680474:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787893460.680485:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787893460.680516:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493503616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.680543:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3631:x1874741493503616:12345-0@lo:400:kworker.0 Request processed in 52us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893460.680548:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787893460.680565:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893460.680568:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787893460.680587:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c3e6f100 x1874741493502720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787893485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787893460.680599:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787893460.680606:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787893460.680611:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787893460.680613:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c7747000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787893460.680626:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787893460.680631:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3629:1874741493502720:0@lo:8:kworker.0 00010000:00080000:2.0:1787893460.680642:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67aa300 x1874741493503232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787893485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787893460.680649:0:3629:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787893460.680653:0:3629:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787893460.680656:0:3629:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787893460.680657:0:3629:0:(import.c:65:import_set_state_nolock()) ffff9fc8c75fc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787893460.680683:0:3629:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787893460.680687:0:3629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3629:1874741493503232:0@lo:8:kworker.0 00000004:00080000:2.0:1787893460.680731:0:22790:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787893460.680748:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67a9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22790:1874741493504128:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787893460.680772:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.680788:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3048180 going to sleep for 11 seconds 00000004:00080000:2.0:1787893460.680801:0:22789:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787893460.680868:0:22789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 704502375709ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787893460.680873:0:22789:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787893460.680905:0:23508:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787893460.680919:0:23508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23508:1874741493504384:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787893460.680940:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.680950:0:23508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9d29e0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893460.681154:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493503104 00000100:00100000:1.0:1787893460.681160:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493503104 00000100:00100000:1.0:1787893460.681189:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493504128 00000100:00100000:1.0:1787893460.681192:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493504128 00000100:00100000:1.0:1787893460.681203:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493504384 00000100:00100000:1.0:1787893460.681206:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493504384 00000100:00100000:1.0:1787893460.681217:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893460.681223:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493503104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893460.681270:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493503104:12345-0@lo:400:kworker.0 Request processed in 47us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893460.681277:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893460.681291:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787893460.681297:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22790:x1874741493504128:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1787893460.681462:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893460.681465:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893460.681485:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493504256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893460.681539:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893460.681573:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493504256 00000100:00100000:1.0:1787893460.681578:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493504256 00000100:00100000:1.0:1787893460.681601:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893460.681607:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1874741493504256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893460.681623:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787893460.681657:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3630:x1874741493504256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893460.681662:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787893460.681691:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c3e6f100 x1874741493504256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893460.681705:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493504256:0@lo:13:osp-pre-1-1.0 00002000:00080000:1.0:1787893460.687160:0:24270:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787893460.687172:0:24270:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1787893460.687179:0:24270:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:3.0:1787893460.687727:0:23507:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787893460.687816:0:23507:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 704509323884ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787893460.687824:0:23507:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787893460.690508:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493504000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893460.690583:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893460.690676:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493502976:0@lo:400:kworker.0 00010000:00080000:2.0:1787893460.690693:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67a9500 x1874741493503616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893460.690703:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3631:1874741493503616:0@lo:400:kworker.0 00000100:00100000:2.0:1787893460.690714:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493503104:0@lo:400:kworker.0 00010000:00080000:2.0:1787893460.690724:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67ab100 x1874741493503744/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893460.690732:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493503744:0@lo:400:kworker.0 00000100:00100000:3.0:1787893460.690844:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493504000 00000100:00100000:3.0:1787893460.690851:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493504000 00000100:00100000:3.0:1787893460.690904:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787893460.690913:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493504000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893460.690939:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787893460.690996:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3633:x1874741493504000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893460.691011:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787893460.691045:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c67aa300 x1874741493504000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893460.691058:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493504000:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1787893460.693329:0:22743:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787893460.693631:0:23497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1787893460.709162:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.709174:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb19d19/0x9232577658cf29fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.709198:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.709203:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.709209:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb19d19/0x9232577658cf29fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.709232:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb19d19/0x9232577658cf29fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.709243:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb19d19/0x9232577658cf29fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.709250:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb19d19/0x9232577658cf29fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.709274:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893460.709294:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893460.709302:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdb19d19/0x9232577658cf29fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.709313:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893460.709318:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb19d19/0x9232577658cf29fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.709330:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb19d19/0x9232577658cf29fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.709351:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdb19d19/0x9232577658cf29fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.709359:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdb19d19/0x9232577658cf29fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.709381:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893460.709383:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893460.709391:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.709764:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.709771:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac28bc9a/0x9232577658cf2a05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.709780:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.709784:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.709789:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac28bc9a/0x9232577658cf2a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.709798:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac28bc9a/0x9232577658cf2a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.709817:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac28bc9a/0x9232577658cf2a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.709826:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac28bc9a/0x9232577658cf2a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.709850:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893460.713042:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893460.713057:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac28bc9a/0x9232577658cf2a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.713071:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893460.713077:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac28bc9a/0x9232577658cf2a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.713087:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac28bc9a/0x9232577658cf2a05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.713109:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac28bc9a/0x9232577658cf2a05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.713116:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac28bc9a/0x9232577658cf2a05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.713145:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893460.713147:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893460.713148:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787893460.715956:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893460.715971:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2a0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716000:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1787893460.716004:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893460.716011:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716034:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716045:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716054:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716070:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787893460.716661:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893460.716668:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf2a13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716678:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1787893460.716681:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893460.716686:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf2a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716695:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf2a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716704:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf2a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716724:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf2a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716739:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787893460.716750:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893460.716755:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716762:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893460.716767:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716776:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2a0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716791:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2a0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716798:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000136cf3a3/0x9232577658cf2a0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716814:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893460.716817:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf2a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716835:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9edb31000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893460.716838:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf2a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716846:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf2a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716857:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf2a13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716864:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001414b08e/0x9232577658cf2a13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.716876:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893460.716878:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893460.716879:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787893460.717187:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893460.717194:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2a1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.717202:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1787893460.717206:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893460.717210:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.717220:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.717235:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.717242:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.717265:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893460.718698:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893460.718709:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.718731:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.718735:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.718746:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2a1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.718763:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2a1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.718771:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e543cf83/0x9232577658cf2a1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.718793:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.718803:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.718806:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893460.720192:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.720380:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.720389:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2a21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.720405:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.720409:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.720415:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.720442:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.720452:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.720459:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.720480:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893460.720563:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893460.720570:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.720580:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893460.720585:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.720596:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2a21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.720614:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2a21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.720621:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2a21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.720641:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893460.720651:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893460.720653:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.721141:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.721148:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2a28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.721158:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.721162:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.721167:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.721184:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.721192:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.721200:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.721225:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893460.721287:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893460.721294:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.721303:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893460.721307:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.721316:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2a28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.721333:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2a28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.721340:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2a28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.721355:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893460.721357:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893460.721358:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.721544:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.721550:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2a2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.721559:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.721562:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.721566:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.721575:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.721583:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.721601:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.721612:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893460.722049:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893460.722056:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.722064:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893460.722068:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.722083:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2a2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.722096:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2a2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.722103:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2a2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.722123:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893460.722125:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893460.722127:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.722160:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.722166:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722174:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.722177:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.722181:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722189:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722196:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722202:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722223:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893460.722532:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.722538:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722552:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.722555:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.722559:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722569:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722578:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722585:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722600:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787893460.722608:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893460.722611:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722629:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.722632:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722640:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722663:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722669:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722684:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893460.722687:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722694:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.722697:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722704:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722713:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722731:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.722744:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.722746:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.722753:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893460.723935:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787893460.725684:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893460.725698:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf2a44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.725715:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1787893460.725718:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893460.725725:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf2a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.725738:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf2a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.725747:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf2a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.725754:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf2a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.725778:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893460.726020:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893460.726028:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf2a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.726035:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893460.726041:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf2a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.726049:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf2a44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.726067:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf2a44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.726081:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5a51341/0x9232577658cf2a44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.726101:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893460.726104:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893460.726105:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787893460.726300:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787893460.726306:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb4fae26/0x9232577658cf2a4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.726314:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1787893460.726316:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893460.726320:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4fae26/0x9232577658cf2a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.726334:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb4fae26/0x9232577658cf2a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.726342:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb4fae26/0x9232577658cf2a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.726348:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4fae26/0x9232577658cf2a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.726371:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893460.726738:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893460.726746:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb4fae26/0x9232577658cf2a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.726756:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.726760:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb4fae26/0x9232577658cf2a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.726770:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb4fae26/0x9232577658cf2a4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.726783:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb4fae26/0x9232577658cf2a4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.726791:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb4fae26/0x9232577658cf2a4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.726809:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.726810:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.726812:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.729323:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.729338:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2a52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.729356:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.729360:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.729366:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.729390:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.729402:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.729410:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.729442:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893460.730303:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893460.730313:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.730325:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893460.730330:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.730341:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2a52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.730359:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2a52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.730367:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2a52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.730388:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893460.730390:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893460.730392:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893460.731626:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893460.731635:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041b1528f/0x9232577658cf2a59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.731649:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=704s v=(0 0) 00010000:00010000:2.0:1787893460.731653:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893460.731659:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041b1528f/0x9232577658cf2a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.731672:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041b1528f/0x9232577658cf2a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.731681:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041b1528f/0x9232577658cf2a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.731689:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041b1528f/0x9232577658cf2a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.731714:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893460.731845:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893460.731853:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041b1528f/0x9232577658cf2a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.731862:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69d000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.731868:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041b1528f/0x9232577658cf2a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.731877:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041b1528f/0x9232577658cf2a59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.731892:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041b1528f/0x9232577658cf2a59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.731899:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041b1528f/0x9232577658cf2a59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.731923:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.731925:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.731927:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787893460.737139:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787893460.737155:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000878ce811/0x9232577658cf2a60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.737189:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=704s v=(0 0) 00010000:00010000:2.0:1787893460.737194:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893460.737200:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000878ce811/0x9232577658cf2a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.737227:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000878ce811/0x9232577658cf2a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.737238:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000878ce811/0x9232577658cf2a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.737245:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000878ce811/0x9232577658cf2a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893460.737275:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893460.738649:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893460.738660:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000878ce811/0x9232577658cf2a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.738671:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69c400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893460.738676:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000878ce811/0x9232577658cf2a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.738686:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000878ce811/0x9232577658cf2a60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.738705:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000878ce811/0x9232577658cf2a60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.738713:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000878ce811/0x9232577658cf2a60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893460.738751:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893460.738753:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893460.738755:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787893460.744985:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893460.745002:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d993b68e/0x9232577658cf2a67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.745018:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1787893460.745023:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893460.745029:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d993b68e/0x9232577658cf2a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.745046:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d993b68e/0x9232577658cf2a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.745057:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d993b68e/0x9232577658cf2a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.745065:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d993b68e/0x9232577658cf2a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.745094:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787893460.746909:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893460.746922:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e9de250/0x9232577658cf2a6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.746943:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1787893460.746947:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893460.746954:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e9de250/0x9232577658cf2a6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.746968:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e9de250/0x9232577658cf2a6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.746989:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e9de250/0x9232577658cf2a6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.746996:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e9de250/0x9232577658cf2a6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.747012:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787893460.748606:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893460.748627:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d993b68e/0x9232577658cf2a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.748640:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.748646:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d993b68e/0x9232577658cf2a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.748656:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d993b68e/0x9232577658cf2a67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.748678:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d993b68e/0x9232577658cf2a67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.748685:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d993b68e/0x9232577658cf2a67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.748711:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893460.748715:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e9de250/0x9232577658cf2a6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.748733:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7f200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.748751:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e9de250/0x9232577658cf2a6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.748760:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e9de250/0x9232577658cf2a6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.748772:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e9de250/0x9232577658cf2a6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.748778:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e9de250/0x9232577658cf2a6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.748793:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.748795:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.748797:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787893460.748802:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.748806:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.748811:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc508940/0x9232577658cf2a75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.748823:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1787893460.748827:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893460.748833:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc508940/0x9232577658cf2a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.748844:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc508940/0x9232577658cf2a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.748866:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc508940/0x9232577658cf2a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.748874:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc508940/0x9232577658cf2a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.748900:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893460.750033:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893460.750041:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc508940/0x9232577658cf2a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.750051:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.750056:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc508940/0x9232577658cf2a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.750065:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc508940/0x9232577658cf2a75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.750080:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc508940/0x9232577658cf2a75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.750098:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc508940/0x9232577658cf2a75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.750120:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.750122:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.750123:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.753913:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.753929:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2a7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.753946:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.753952:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.753958:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.753973:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.753995:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.754002:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.754032:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893460.754128:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893460.754136:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.754147:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893460.754151:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.754162:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2a7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.754180:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2a7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.754188:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2a7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.754210:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.754220:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.754222:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.754595:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.754607:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.754617:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.754805:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.754811:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.754823:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.754832:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.754839:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.754865:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893460.758008:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893460.758022:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.758036:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728800 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893460.758040:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.758051:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.758073:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.758080:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008706372d/0x9232577658cf2a83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.758109:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.758111:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.758113:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787893460.758362:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893460.758370:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf2a8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.758382:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1787893460.758386:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893460.758404:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf2a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.758418:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf2a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.758427:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf2a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.758435:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf2a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.758462:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893460.758535:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893460.758543:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf2a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.758554:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7fe00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.758558:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf2a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.758567:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf2a8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.758589:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf2a8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.758596:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f7df9f3/0x9232577658cf2a8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.758615:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.758617:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.758630:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787893460.761402:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893460.761417:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf2a91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.761435:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1787893460.761440:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893460.761446:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf2a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.761462:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf2a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.761471:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf2a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.761520:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf2a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.761543:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893460.761611:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893460.761624:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf2a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.761634:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.761639:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf2a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.761648:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf2a91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.761666:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf2a91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.761674:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef0c62e5/0x9232577658cf2a91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.761708:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.761710:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.761711:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787893460.762568:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787893460.762578:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e659e5a0/0x9232577658cf2a98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.762590:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1787893460.762594:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893460.762599:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e659e5a0/0x9232577658cf2a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.762610:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e659e5a0/0x9232577658cf2a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.762629:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e659e5a0/0x9232577658cf2a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.762637:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e659e5a0/0x9232577658cf2a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.762655:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893460.762865:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893460.762871:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e659e5a0/0x9232577658cf2a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.762880:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.762884:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e659e5a0/0x9232577658cf2a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.762892:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e659e5a0/0x9232577658cf2a98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.762906:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e659e5a0/0x9232577658cf2a98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.762913:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e659e5a0/0x9232577658cf2a98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.762929:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.762931:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.762932:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.763932:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.763942:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.763965:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.763969:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.763986:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.763997:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764006:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764014:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764038:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893460.764413:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.764419:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2aa6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764429:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.764444:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.764449:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764459:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764479:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764486:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764611:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787893460.764631:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893460.764638:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764645:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729400 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.764651:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764659:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764673:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764681:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b561ae1/0x9232577658cf2a9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764697:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893460.764707:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764713:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:1.0:1787893460.764717:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764799:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2aa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764810:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2aa6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764817:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2aa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.764830:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.764832:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893460.764834:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.765301:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.765388:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.765394:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2aad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.765404:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.765407:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.765412:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.765442:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.765451:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.765458:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.765478:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893460.765642:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893460.765653:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.765662:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893460.765665:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.765673:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2aad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.765685:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2aad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.765692:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca4c469d/0x9232577658cf2aad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.765705:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.765707:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.765709:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.767377:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.767390:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2ab4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.767405:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.767409:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.767414:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.767426:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.767446:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.767465:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.767512:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893460.767732:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893460.767739:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.767747:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893460.767752:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.767773:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2ab4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.767788:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2ab4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.767794:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b76c75bd/0x9232577658cf2ab4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.767812:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.767814:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.767816:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.768549:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.768558:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2abb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.768570:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.768574:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.768579:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.768591:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.768600:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.768606:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.768625:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893460.769142:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893460.769150:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.769159:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729600 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893460.769164:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.769173:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2abb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.769188:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2abb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.769223:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fa7179a/0x9232577658cf2abb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.769246:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.769248:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.769250:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.772652:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.772669:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2ac2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.772702:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.772708:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.772716:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.772742:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.772753:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.772761:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.772779:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893460.773054:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893460.773062:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.773071:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728a00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893460.773075:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.773085:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2ac2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.773103:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2ac2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.773110:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d67fc54a/0x9232577658cf2ac2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.773129:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.773131:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.773133:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.775323:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.775339:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2ac9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.775356:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.775360:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.775366:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2ac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.775379:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2ac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.775405:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2ac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.775413:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2ac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.775438:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893460.775728:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893460.775736:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2ac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.775744:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893460.775749:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2ac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.775758:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2ac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.775775:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2ac9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.775783:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf969c49/0x9232577658cf2ac9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.775801:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.775803:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.775805:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893460.776706:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787893460.776716:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2ad0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.776729:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1787893460.776732:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893460.776737:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2ad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.776748:0:24270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2ad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.776757:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2ad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.776765:0:24270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893460.776804:0:24270:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787893460.776861:0:24270:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:1.0:1787893460.776956:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22790:x1874741493504128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 95655us (96179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893460.776965:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787893460.777033:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67a9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22790:1874741493504128:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787893460.777047:0:22790:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1787893460.777090:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22790:1874741493504512:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787893460.777123:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893460.777147:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c3048180 going to sleep for 11 seconds 00000100:00100000:1.0:1787893460.777167:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493504512 00000100:00100000:1.0:1787893460.777173:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493504512 00010000:00010000:3.0:1787893460.777296:0:24298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893460.777304:0:24298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.777312:0:24298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729200 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893460.777316:0:24298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.777337:0:24298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2ad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.777351:0:24298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2ad0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.777357:0:24298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2ad0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893460.777375:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.777378:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893460.777380:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893460.777852:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787893460.777867:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7202d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23508:x1874741493504384:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:1.0:1787893460.782232:0:24273:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787893460.782243:0:24273:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787893460.782405:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7202d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23508:x1874741493504384:12345-0@lo:7:osp-pre-1-1.0 Request processed in 4538us (101458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893460.782417:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787893460.782465:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893460.782480:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22790:x1874741493504512:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787893460.782545:0:24273:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1787893460.785368:0:23508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23508:1874741493504384:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787893460.785391:0:23508:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787893460.785449:0:23508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23508:1874741493504640:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787893460.785532:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893460.785567:0:23508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd043300 going to sleep for 11 seconds 00000100:00100000:3.0:1787893460.785717:0:24272:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787893460.785726:0:24272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787893460.785825:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493504640 00000100:00100000:3.0:1787893460.785832:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493504640 00000100:00100000:3.0:1787893460.785948:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787893460.785957:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23508:x1874741493504640:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787893460.785999:0:25379:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1787893460.786039:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23508:x1874741493504640:12345-0@lo:5:osp-pre-1-1.0 Request processed in 82us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893460.786054:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787893460.786084:0:23508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23508:1874741493504640:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787893460.786095:0:23508:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787893460.786121:0:23508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23508:1874741493504768:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787893460.786145:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893460.786160:0:23508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd043300 going to sleep for 11 seconds 00000100:00100000:3.0:1787893460.786171:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493504768 00000100:00100000:3.0:1787893460.786175:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493504768 00000100:00100000:3.0:1787893460.786192:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787893460.786198:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23508:x1874741493504768:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787893460.786692:0:24272:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000001:00080000:3.0:1787893460.805933:0:25088:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1787893460.806009:0:25088:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787893460.806015:0:25088:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787893460.809474:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22790:x1874741493504512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 26989us (32340us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787893460.809487:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787893460.809888:0:22790:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787893460.809897:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22790:1874741493504512:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787893460.809914:0:22790:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:2.0:1787893460.849716:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23508:x1874741493504768:12345-0@lo:5:osp-pre-1-1.0 Request processed in 63377us (63428us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787893460.849731:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787893460.849797:0:23508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23508:1874741493504768:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787893460.849814:0:23508:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1787893460.849859:0:23508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23508:1874741493504896:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787893460.849898:0:23508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893460.849928:0:23508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fd043300 going to sleep for 11 seconds 00000100:00100000:1.0:1787893460.851696:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493504896 00000100:00100000:1.0:1787893460.851709:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493504896 00000100:00100000:1.0:1787893460.851776:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787893460.851787:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23508:x1874741493504896:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787893460.851882:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23508:x1874741493504896:12345-0@lo:900:osp-pre-1-1.0 Request processed in 97us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893460.851890:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787893460.851933:0:23508:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc8c7524e00 x1874741493504896/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787893476 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893460.851947:0:23508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23508:1874741493504896:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787893461.044919:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787893461.491222:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787893462.090841:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787893462.312139:0:25444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg235-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787893463.153822:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787893463.316738:0:25496:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787893463.317063:0:25496:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787893463.729842:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493505024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893463.729919:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893463.730153:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493505024 00000100:00100000:1.0:1787893463.730161:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493505024 00000100:00100000:1.0:1787893463.730265:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787893463.730275:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493505024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787893463.730304:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787893463.730355:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493505024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893463.730362:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787893463.730479:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493505024:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787893463.731518:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787893464.177636:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893464.248765:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493505280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893464.248838:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893464.248891:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893464.248898:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493505152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893464.248936:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893464.249013:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493505280 00000100:00100000:0.0:1787893464.249021:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493505280 00000100:00100000:0.0:1787893464.249073:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493505152 00000100:00100000:0.0:1787893464.249076:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493505152 00000100:00100000:0.0:1787893464.249092:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787893464.249101:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493505280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787893464.249136:0:23786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787893464.249178:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493505280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893464.249184:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787893464.249206:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787893464.249212:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493505152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893464.249227:0:23786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787893464.249260:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493505152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893464.249265:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787893464.249437:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493505152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893464.249449:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493505280:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1787893464.422001:0:25546:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787893464.422290:0:25546:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787893464.754513:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893464.754536:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493505408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893464.754604:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893464.754714:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493505408 00000100:00100000:2.0:1787893464.754722:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493505408 00000100:00100000:2.0:1787893464.754792:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787893464.754802:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493505408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893464.754823:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893464.754868:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493505408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893464.754876:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787893464.754934:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893464.755037:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493505408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893464.865140:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893464.865250:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481852928 00000100:00100000:2.0:1787893464.865275:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481852928 00000100:00100000:2.0:1787893464.865325:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:2.0:1787893464.865333:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2389:x1874741481852928:12345-192.168.202.35@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787893464.865363:0:22758:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7d609832-c190-4f05-b711-9e10bcf3662d@192.168.202.35@tcp t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:2.0:1787893464.865398:0:22758:0:(genops.c:1385:class_connect()) connect: client 7d609832-c190-4f05-b711-9e10bcf3662d, cookie 0x9232577658cf2ad7 00000100:00080000:2.0:1787893464.865588:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9fc9d909d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893464.865711:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+5:2389:x1874741481852928:12345-192.168.202.35@tcp:250:mount.lustre.0 Request processed in 377us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893464.865720:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 116 00000100:00100000:1.0:1787893464.882043:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893464.882237:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481853056 00000100:00100000:3.0:1787893464.882246:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481853056 00000100:00100000:3.0:1787893464.882308:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 117 00000100:00100000:3.0:1787893464.882318:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+5:18076:x1874741481853056:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787893464.882335:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893464.882351:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541800/0x9232577658cf2ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62facc7 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893464.882378:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541800/0x9232577658cf2ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facc7 expref: 6 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893464.882389:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541800/0x9232577658cf2ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facc7 expref: 6 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893464.883235:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541800, rc 0) 00000100:00100000:3.0:1787893464.883297:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+6:18076:x1874741481853056:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 979us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893464.883305:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 117 00000100:00100000:1.0:1787893464.889199:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893464.889950:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481853184 00000100:00100000:2.0:1787893464.889962:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481853184 00000100:00100000:2.0:1787893464.890026:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 118 00000100:00100000:2.0:1787893464.890037:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+6:18076:x1874741481853184:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787893464.890159:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+6:18076:x1874741481853184:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 124us (970us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787893464.890167:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 118 00000100:00100000:0.0:1787893464.915637:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893464.915761:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481853312 00000100:00100000:3.0:1787893464.915772:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481853312 00000100:00100000:3.0:1787893464.915832:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:3.0:1787893464.915843:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+6:18076:x1874741481853312:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787893464.915860:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893464.915888:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540200/0x9232577658cf2ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62facce expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893464.915916:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540200/0x9232577658cf2ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facce expref: 7 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893464.915927:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540200/0x9232577658cf2ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facce expref: 7 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893464.915953:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540200, rc 0) 00000100:00100000:3.0:1787893464.916010:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+7:18076:x1874741481853312:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 169us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893464.916017:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 119 00000100:00100000:1.0:1787893464.919459:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893464.919604:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481853440 00000100:00100000:0.0:1787893464.919614:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481853440 00000100:00100000:0.0:1787893464.919680:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:0.0:1787893464.919690:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+7:18076:x1874741481853440:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787893464.919853:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+8:18076:x1874741481853440:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 164us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893464.919861:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 120 00000100:00100000:1.0:1787893464.929482:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893464.929650:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481853568 00000100:00100000:2.0:1787893464.929659:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481853568 00000100:00100000:2.0:1787893464.929717:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:2.0:1787893464.929727:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+8:18076:x1874741481853568:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787893464.929875:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+8:18076:x1874741481853568:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 149us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893464.929883:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 121 00000100:00100000:1.0:1787893464.935370:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893464.935452:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481853696 00000100:00100000:3.0:1787893464.935462:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481853696 00000100:00100000:3.0:1787893464.936269:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 122 00000100:00100000:3.0:1787893464.936283:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+8:18094:x1874741481853696:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787893464.936428:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+8:18094:x1874741481853696:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 150us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893464.936436:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 122 00000100:00100000:1.0:1787893464.979130:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893464.980627:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481853824 00000100:00100000:0.0:1787893464.980640:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481853824 00000100:00100000:0.0:1787893464.980715:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:0.0:1787893464.980726:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+8:18094:x1874741481853824:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787893464.980895:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+8:18094:x1874741481853824:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 170us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893464.980903:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 123 00000100:00100000:1.0:1787893464.991125:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893464.991203:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481853952 00000100:00100000:2.0:1787893464.991214:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481853952 00000100:00100000:2.0:1787893464.991280:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:2.0:1787893464.991305:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+8:18094:x1874741481853952:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893464.991448:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+8:18094:x1874741481853952:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 145us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893464.991456:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 124 00000100:00100000:1.0:1787893464.997590:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893464.997798:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481854080 00000100:00100000:2.0:1787893464.997808:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481854080 00000100:00100000:2.0:1787893464.997872:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:2.0:1787893464.997882:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+8:18076:x1874741481854080:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787893464.997897:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893464.997913:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf2aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62facff expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893464.997949:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf2aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facff expref: 9 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893464.997959:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd69d000/0x9232577658cf2aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62facff expref: 9 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893464.997967:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69d000, rc 0) 00000100:00100000:2.0:1787893464.998021:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+9:18076:x1874741481854080:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 141us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893464.998027:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 125 00000100:00100000:1.0:1787893465.014486:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893465.014633:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481854208 00000100:00100000:0.0:1787893465.014643:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481854208 00000100:00100000:0.0:1787893465.014703:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00100000:0.0:1787893465.014726:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+9:18076:x1874741481854208:12345-192.168.202.35@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787893465.014751:0:22755:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787893465.014766:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787893465.014769:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787893465.014772:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787893465.014775:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787893465.014777:0:22755:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1787893465.023454:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+9:18076:x1874741481854208:12345-192.168.202.35@tcp:256:mount.lustre.0 Request processed in 8718us (8967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893465.023468:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 126 00000100:00100000:1.0:1787893465.026686:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893465.026856:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481854336 00000100:00100000:0.0:1787893465.026866:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481854336 00000100:00100000:0.0:1787893465.026924:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 127 00000100:00100000:0.0:1787893465.026944:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+9:18076:x1874741481854336:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787893465.026962:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893465.026981:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2af3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fad06 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893465.027010:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad06 expref: 10 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893465.027021:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad06 expref: 10 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893465.027030:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1c00, rc 0) 00000100:00100000:0.0:1787893465.027087:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+10:18076:x1874741481854336:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 153us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893465.027094:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 127 00000100:00100000:1.0:1787893465.029442:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893465.029621:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481854464 00000100:00100000:0.0:1787893465.029634:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481854464 00000100:00100000:0.0:1787893465.029787:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 128 00000100:00100000:0.0:1787893465.029800:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+10:18076:x1874741481854464:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787893465.030036:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+10:18076:x1874741481854464:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 238us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893465.030046:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 128 00000100:00100000:1.0:1787893465.033414:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893465.037456:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481854592 00000100:00100000:2.0:1787893465.037481:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481854592 00000100:00100000:2.0:1787893465.037579:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 129 00000100:00100000:2.0:1787893465.037592:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+10:18076:x1874741481854592:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787893465.037818:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+10:18076:x1874741481854592:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 227us (4429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.037834:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 129 00000100:00100000:1.0:1787893465.044688:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893465.044880:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481854720 00000100:00100000:2.0:1787893465.044893:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481854720 00000100:00100000:2.0:1787893465.045031:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00100000:2.0:1787893465.045044:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+10:18098:x1874741481854720:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893465.045656:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+10:18098:x1874741481854720:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 612us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.045665:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 130 00000100:00100000:1.0:1787893465.051691:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893465.051829:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481854848 00000100:00100000:3.0:1787893465.051844:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481854848 00000100:00100000:3.0:1787893465.051910:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00100000:3.0:1787893465.051922:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+10:18098:x1874741481854848:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787893465.053245:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+10:18098:x1874741481854848:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 1317us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893465.053257:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 131 00000100:00100000:1.0:1787893465.060533:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893465.061949:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481854976 00000100:00100000:2.0:1787893465.061977:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481854976 00000100:00100000:2.0:1787893465.062136:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:2.0:1787893465.062148:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2389:x1874741481854976:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787893465.062189:0:24576:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from dd6f19be-6c98-4c86-964a-533d4d057bbd@192.168.202.35@tcp t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:2.0:1787893465.062264:0:24576:0:(genops.c:1385:class_connect()) connect: client dd6f19be-6c98-4c86-964a-533d4d057bbd, cookie 0x9232577658cf2afa 00000004:00100000:2.0:1787893465.062300:0:24576:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787893465.062624:0:24576:0:(import.c:65:import_set_state_nolock()) ffff9fc9c7e96800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893465.062728:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2389:x1874741481854976:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 580us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.062737:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:1.0:1787893465.073821:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893465.073925:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481855232 00000100:00100000:2.0:1787893465.073953:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481855232 00000100:00100000:2.0:1787893465.074031:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:2.0:1787893465.074042:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1874741481855232:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787893465.074097:0:22764:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from dd6f19be-6c98-4c86-964a-533d4d057bbd@192.168.202.35@tcp t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:2.0:1787893465.074183:0:22764:0:(genops.c:1385:class_connect()) connect: client dd6f19be-6c98-4c86-964a-533d4d057bbd, cookie 0x9232577658cf2b01 00000004:00100000:2.0:1787893465.074219:0:22764:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787893465.074449:0:22764:0:(import.c:65:import_set_state_nolock()) ffff9fc9e7df1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893465.074561:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2389:x1874741481855232:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 519us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.074567:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:1.0:1787893465.093982:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893465.095541:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481855488 00000100:00100000:0.0:1787893465.095562:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481855488 00000100:00100000:0.0:1787893465.095732:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:0.0:1787893465.095746:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18076:x1874741481855488:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787893465.095789:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787893465.096127:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18076:x1874741481855488:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 383us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893465.096137:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00080000:1.0:1787893465.096195:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893465.105829:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893465.105880:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893465.105909:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893465.107674:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481855360 00000100:00100000:1.0:1787893465.107693:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481855360 00000100:00100000:1.0:1787893465.107798:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481855104 00000100:00100000:1.0:1787893465.107802:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481855104 00000100:00100000:1.0:1787893465.107818:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481855616 00000100:00100000:1.0:1787893465.107821:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481855616 00000100:00100000:1.0:1787893465.107841:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787893465.107853:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:0:x1874741481855360:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787893465.107895:0:24576:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787893465.108031:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:0:x1874741481855360:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 180us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893465.108040:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787893465.108074:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:1.0:1787893465.108099:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:0:x1874741481855104:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787893465.108113:0:24576:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787893465.108144:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:0:x1874741481855104:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 47us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893465.108150:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:1.0:1787893465.108162:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:1.0:1787893465.108169:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18076:x1874741481855616:12345-192.168.202.35@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787893465.108199:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18076:x1874741481855616:12345-192.168.202.35@tcp:40:mount.lustre.0 Request processed in 30us (2289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893465.108205:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00080000:0.0:1787893465.108381:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893465.123295:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893465.123373:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893465.124203:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481856000 00000100:00100000:1.0:1787893465.124219:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481856000 00000100:00100000:1.0:1787893465.124301:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:1.0:1787893465.124315:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18076:x1874741481856000:12345-192.168.202.35@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787893465.124453:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18076:x1874741481856000:12345-192.168.202.35@tcp:900:mount.lustre.0 Request processed in 142us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893465.124462:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:1.0:1787893465.128093:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893465.131432:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893465.132130:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481856128 00000100:00100000:2.0:1787893465.132144:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481856128 00000100:00100000:2.0:1787893465.132230:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 132 00000100:00100000:2.0:1787893465.132243:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+10:2391:x1874741481856128:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893465.132347:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+10:2391:x1874741481856128:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 104us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.132356:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 132 00000100:00100000:0.0:1787893465.134838:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481855744 00000100:00100000:0.0:1787893465.134857:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481855744 00000100:00100000:3.0:1787893465.137488:0:25379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481855872 00000100:00100000:3.0:1787893465.137548:0:25379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481855872 00000100:00100000:2.0:1787893465.137903:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:2.0:1787893465.137916:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1874741481855744:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787893465.138194:0:24270:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dd6f19be-6c98-4c86-964a-533d4d057bbd@192.168.202.35@tcp t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:2.0:1787893465.138268:0:24270:0:(genops.c:1385:class_connect()) connect: client dd6f19be-6c98-4c86-964a-533d4d057bbd, cookie 0x9232577658cf2b08 00002000:00100000:2.0:1787893465.138284:0:24270:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd6f19be-6c98-4c86-964a-533d4d057bbd/ffff9fc9e7df1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893465.138299:0:24270:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893465.138719:0:24270:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787893465.138769:0:24270:0:(import.c:65:import_set_state_nolock()) ffff9fc9e7df0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893465.139134:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2389:x1874741481855744:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 1217us (15758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.139144:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:2.0:1787893465.143890:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:2.0:1787893465.143907:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874741481855872:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787893465.144255:0:25379:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from dd6f19be-6c98-4c86-964a-533d4d057bbd@192.168.202.35@tcp t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:2.0:1787893465.144300:0:25379:0:(genops.c:1385:class_connect()) connect: client dd6f19be-6c98-4c86-964a-533d4d057bbd, cookie 0x9232577658cf2b0f 00002000:00100000:2.0:1787893465.144318:0:25379:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd6f19be-6c98-4c86-964a-533d4d057bbd/ffff9fc9e7df4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893465.144342:0:25379:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893465.144614:0:25379:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787893465.144656:0:25379:0:(import.c:65:import_set_state_nolock()) ffff9fc9e7df2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893465.147239:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2389:x1874741481855872:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 3316us (19144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.147258:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:1.0:1787893465.147473:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893465.148334:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481856256 00000100:00100000:2.0:1787893465.148349:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481856256 00000100:00100000:2.0:1787893465.148698:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:2.0:1787893465.148712:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18076:x1874741481856256:12345-192.168.202.35@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787893465.151532:0:22766:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2698us 00000004:00200000:2.0:1787893465.187808:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787893465.188025:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18076:x1874741481856256:12345-192.168.202.35@tcp:33:mount.lustre.0 Request processed in 39306us (40543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.188039:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00010000:00010000:1.0:1787893465.213482:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787893465.333254:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787893465.353264:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893465.353633:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481856384 00000100:00100000:1.0:1787893465.353647:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481856384 00000100:00100000:1.0:1787893465.353723:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:1.0:1787893465.353866:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c778b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18121:x1874741481856384:12345-192.168.202.35@tcp:101:mkdir.0 00010000:00010000:1.0:1787893465.353896:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893465.353931:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729000/0x9232577658cf2b16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fad37 expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893465.354040:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728a00/0x9232577658cf2b1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893465.354328:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728a00/0x9232577658cf2b1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893465.354349:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728a00/0x9232577658cf2b1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893465.354433:0:24576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787893465.354437:0:24576:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787893465.354485:0:24576:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728a00/0x9232577658cf2b1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893465.354553:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729000/0x9232577658cf2b16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad37 expref: 8 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893465.354576:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728a00/0x9232577658cf2b1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad37 expref: 7 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893465.354586:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c6ebd400) 00010000:00010000:1.0:1787893465.354590:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787893465.354594:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd728a00, rc 0) 00000100:00100000:1.0:1787893465.354685:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c778b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:18121:x1874741481856384:12345-192.168.202.35@tcp:101:mkdir.0 Request processed in 821us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893465.363537:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:2.0:1787893465.777905:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493505536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893465.778027:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893465.778152:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493505536 00000100:00100000:2.0:1787893465.778162:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493505536 00000100:00100000:2.0:1787893465.778233:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893465.778247:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3631:x1874741493505536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787893465.778296:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787893465.778350:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3631:x1874741493505536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.778358:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787893465.778386:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893465.778422:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493505536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893465.778736:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493506048:0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.778777:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893465.778799:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493506560:0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.778827:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893465.778847:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493507072:0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.778874:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893465.778894:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787893465.778900:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493505920:0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.778924:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893465.778963:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493506432:0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.778986:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893465.779002:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493506944:0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.779023:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893465.779049:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493506560 00000100:00100000:1.0:1787893465.779055:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493506560 00000100:00100000:1.0:1787893465.779103:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493507072 00000100:00100000:1.0:1787893465.779106:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493507072 00000100:00100000:1.0:1787893465.779127:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493506944 00000100:00100000:1.0:1787893465.779130:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493506944 00000100:00100000:1.0:1787893465.779146:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787893465.779152:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493506560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.779196:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3631:x1874741493506560:12345-0@lo:400:kworker.0 Request processed in 44us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893465.779202:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787893465.779230:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787893465.779237:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493507072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.779268:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3631:x1874741493507072:12345-0@lo:400:kworker.0 Request processed in 31us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893465.779274:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787893465.779286:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787893465.779292:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493506944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.779318:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3631:x1874741493506944:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893465.779324:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787893465.779340:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893465.779343:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787893465.779368:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3631:1874741493506944:0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.779379:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3631:1874741493506560:0@lo:400:kworker.0 00010000:00080000:1.0:1787893465.779392:0:3631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9c700 x1874741493507072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893465.779404:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3631:1874741493507072:0@lo:400:kworker.0 00000100:00100000:2.0:1787893465.779667:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493506048 00000100:00100000:2.0:1787893465.779674:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493506048 00000100:00100000:2.0:1787893465.779722:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493505920 00000100:00100000:2.0:1787893465.779726:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493505920 00000100:00100000:2.0:1787893465.779740:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493506432 00000100:00100000:2.0:1787893465.779742:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493506432 00000100:00100000:2.0:1787893465.779758:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787893465.779765:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493506048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893465.779808:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493506048:12345-0@lo:400:kworker.0 Request processed in 44us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.779815:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787893465.779829:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787893465.779835:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493505920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893465.779863:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493505920:12345-0@lo:400:kworker.0 Request processed in 29us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.779869:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787893465.779878:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787893465.779884:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493506432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893465.779908:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493506432:12345-0@lo:400:kworker.0 Request processed in 24us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893465.779925:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787893465.780057:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493505664:0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780113:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893465.780148:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493506176:0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780173:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893465.780192:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493506688:0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780212:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893465.780232:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787893465.780238:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493505792:0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780264:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893465.780283:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493506304:0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780304:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893465.780323:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493506816:0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780349:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893465.780383:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493506176 00000100:00100000:3.0:1787893465.780388:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493506176 00000100:00100000:3.0:1787893465.780414:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493506688 00000100:00100000:3.0:1787893465.780416:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493506688 00000100:00100000:3.0:1787893465.780430:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493506816 00000100:00100000:3.0:1787893465.780432:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493506816 00000100:00100000:3.0:1787893465.780447:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787893465.780454:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493506176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780520:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1874741493506176:12345-0@lo:400:kworker.0 Request processed in 38us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893465.780538:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787893465.780566:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787893465.780574:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493506688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780607:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493506688:12345-0@lo:400:kworker.0 Request processed in 34us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893465.780612:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787893465.780622:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787893465.780628:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493506816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780655:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493506816:12345-0@lo:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893465.780661:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787893465.780680:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493505792 00000100:00100000:3.0:1787893465.780684:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493505792 00000100:00100000:3.0:1787893465.780707:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493506304 00000100:00100000:3.0:1787893465.780710:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493506304 00000100:00100000:3.0:1787893465.780722:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787893465.780728:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493505792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780761:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493505792:12345-0@lo:400:kworker.0 Request processed in 33us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893465.780767:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787893465.780778:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787893465.780784:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493506304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780810:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493506304:12345-0@lo:400:kworker.0 Request processed in 27us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893465.780816:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787893465.780870:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493505792:0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780880:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493506304:0@lo:400:kworker.0 00010000:00080000:3.0:1787893465.780890:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb9d880 x1874741493506816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893465.780902:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493506816:0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780915:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3632:1874741493506176:0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.780924:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493506688:0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.781060:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493505664 00000100:00100000:3.0:1787893465.781064:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493505664 00000100:00080000:1.0:1787893465.781259:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787893465.781265:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893465.781269:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787893465.781272:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893465.781302:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493505920:0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.781318:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493506432:0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.781331:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493506048:0@lo:400:kworker.0 00000100:00100000:0.0:1787893465.781583:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893465.781593:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493507200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893465.781638:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893465.782594:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787893465.782616:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:3632:x1874741493505664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893465.782709:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:3632:x1874741493505664:12345-0@lo:400:kworker.0 Request processed in 102us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893465.782717:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787893465.783534:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493505664:0@lo:400:kworker.0 00000100:00100000:1.0:1787893465.785403:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493507200 00000100:00100000:1.0:1787893465.785423:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493507200 00000100:00100000:1.0:1787893465.785540:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787893465.785552:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493507200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893465.785585:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787893465.785691:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493507200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (4051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893465.785699:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787893465.785995:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493507200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787893466.227964:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787893466.294308:0:25088:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd6f19be-6c98-4c86-964a-533d4d057bbd 00000001:00080000:3.0:1787893466.294329:0:25088:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1787893467.250537:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893467.656312:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893467.658263:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481856512 00000100:00100000:0.0:1787893467.658304:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481856512 00000100:00100000:0.0:1787893467.658412:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:0.0:1787893467.658428:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:18173:x1874741481856512:12345-192.168.202.35@tcp:41:lfs.0 00000004:00000024:0.0:1787893467.658538:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00080000:1.0:1787893467.659183:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893467.660165:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:18173:x1874741481856512:12345-192.168.202.35@tcp:41:lfs.0 Request processed in 251us (2774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893467.660181:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:2.0:1787893467.662666:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893467.662804:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481856640 00000100:00100000:3.0:1787893467.662819:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481856640 00000100:00100000:3.0:1787893467.662927:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:3.0:1787893467.662942:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18173:x1874741481856640:12345-192.168.202.35@tcp:41:lfs.0 00000004:00000024:3.0:1787893467.662979:0:24576:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787893467.663102:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18173:x1874741481856640:12345-192.168.202.35@tcp:41:lfs.0 Request processed in 164us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893467.663110:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00080000:1.0:1787893467.663262:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787893467.668926:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893467.669151:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481856768 00000100:00100000:1.0:1787893467.669164:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481856768 00000100:00100000:1.0:1787893467.669259:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:1.0:1787893467.669272:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18173:x1874741481856768:12345-192.168.202.35@tcp:13:lfs.0 00002000:00000024:1.0:1787893467.669314:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787893467.669437:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18173:x1874741481856768:12345-192.168.202.35@tcp:13:lfs.0 Request processed in 167us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893467.669445:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00080000:2.0:1787893467.669814:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893467.676602:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893467.676876:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481856896 00000100:00100000:0.0:1787893467.676891:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481856896 00000100:00100000:0.0:1787893467.677000:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:0.0:1787893467.677022:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:18173:x1874741481856896:12345-192.168.202.35@tcp:13:lfs.0 00002000:00000024:0.0:1787893467.677074:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787893467.677195:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:18173:x1874741481856896:12345-192.168.202.35@tcp:13:lfs.0 Request processed in 176us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893467.677204:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00080000:2.0:1787893467.677843:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893468.037587:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893468.040000:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481857024 00000100:00100000:1.0:1787893468.040025:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481857024 00000100:00100000:1.0:1787893468.040122:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00100000:1.0:1787893468.040134:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+10:18208:x1874741481857024:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787893468.040159:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893468.040185:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd729000/0x9232577658cf2b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fad3e expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893468.040241:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd729000/0x9232577658cf2b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad3e expref: 11 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893468.040255:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd729000/0x9232577658cf2b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad3e expref: 11 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893468.040265:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd729000, rc 0) 00000100:00100000:1.0:1787893468.040755:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+11:18208:x1874741481857024:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 620us (3182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893468.040763:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 134 00000100:00100000:3.0:1787893468.049400:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893468.049533:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481857152 00000100:00100000:2.0:1787893468.049544:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481857152 00000100:00100000:2.0:1787893468.049602:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00100000:2.0:1787893468.049612:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+11:18208:x1874741481857152:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787893468.049787:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+11:18208:x1874741481857152:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 175us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893468.049796:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 135 00000100:00100000:2.0:1787893468.057000:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893468.057161:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481857280 00000100:00100000:1.0:1787893468.057171:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481857280 00000100:00100000:1.0:1787893468.057228:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 136 00000100:00100000:1.0:1787893468.057237:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+11:18208:x1874741481857280:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787893468.061437:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+11:18208:x1874741481857280:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 4187us (4434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893468.061453:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 136 00000100:00100000:3.0:1787893468.066200:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893468.066293:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481857408 00000100:00100000:1.0:1787893468.066304:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481857408 00000100:00100000:1.0:1787893468.066364:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00100000:1.0:1787893468.066380:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+11:18212:x1874741481857408:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787893468.071418:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+11:18212:x1874741481857408:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 5024us (5212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893468.071438:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 137 00000100:00100000:3.0:1787893468.093882:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893468.094193:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481857536 00000100:00100000:1.0:1787893468.094218:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481857536 00000100:00100000:1.0:1787893468.094331:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 138 00000100:00100000:1.0:1787893468.094342:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+11:18212:x1874741481857536:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787893468.094545:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+11:18212:x1874741481857536:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 204us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893468.094553:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 138 00000100:00100000:3.0:1787893468.098902:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893468.102444:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481857664 00000100:00100000:2.0:1787893468.102460:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481857664 00000100:00100000:2.0:1787893468.102528:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 139 00000100:00100000:2.0:1787893468.102538:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+11:18212:x1874741481857664:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893468.102699:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+11:18212:x1874741481857664:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 161us (3809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893468.102707:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 139 00000100:00100000:2.0:1787893468.107317:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893468.107354:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481857792 00000100:00100000:2.0:1787893468.107603:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481857792 00000100:00100000:2.0:1787893468.107669:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 140 00000100:00100000:2.0:1787893468.107680:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+11:18208:x1874741481857792:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787893468.107711:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893468.107727:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf2b2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fad6f expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893468.107756:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf2b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad6f expref: 12 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893468.107766:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd69de00/0x9232577658cf2b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad6f expref: 12 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893468.107776:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69de00, rc 0) 00000100:00100000:2.0:1787893468.107825:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+12:18208:x1874741481857792:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 147us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893468.107832:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 140 00000100:00100000:2.0:1787893468.111449:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893468.114076:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481857920 00000100:00100000:0.0:1787893468.114092:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481857920 00000100:00100000:0.0:1787893468.114167:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 141 00000100:00100000:0.0:1787893468.114175:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c6730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+12:18208:x1874741481857920:12345-192.168.202.35@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787893468.114199:0:22758:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787893468.114220:0:22758:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787893468.114223:0:22758:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787893468.114224:0:22758:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787893468.114226:0:22758:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787893468.114228:0:22758:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1787893468.116405:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c6730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+12:18208:x1874741481857920:12345-192.168.202.35@tcp:256:mount.lustre.0 Request processed in 2219us (4956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893468.116432:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 141 00000100:00100000:2.0:1787893468.120068:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893468.120184:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481858048 00000100:00100000:1.0:1787893468.120194:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481858048 00000100:00100000:1.0:1787893468.120305:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 142 00000100:00100000:1.0:1787893468.120316:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+12:18208:x1874741481858048:12345-192.168.202.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787893468.120331:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893468.120349:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9dd729600/0x9232577658cf2b32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fad76 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893468.120377:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9dd729600/0x9232577658cf2b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad76 expref: 13 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893468.120387:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9dd729600/0x9232577658cf2b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad76 expref: 13 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893468.120396:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd729600, rc 0) 00000100:00100000:1.0:1787893468.120453:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+13:18208:x1874741481858048:12345-192.168.202.35@tcp:101:mount.lustre.0 Request processed in 139us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893468.120459:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 142 00000100:00100000:2.0:1787893468.122743:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893468.123571:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481858176 00000100:00100000:0.0:1787893468.123581:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481858176 00000100:00100000:1.0:1787893468.123713:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 143 00000100:00100000:1.0:1787893468.123725:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+13:18208:x1874741481858176:12345-192.168.202.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787893468.123941:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+13:18208:x1874741481858176:12345-192.168.202.35@tcp:501:mount.lustre.0 Request processed in 218us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893468.123950:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 143 00000100:00100000:2.0:1787893468.126429:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893468.128997:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481858304 00000100:00100000:3.0:1787893468.129014:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481858304 00000100:00100000:2.0:1787893468.129329:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 144 00000100:00100000:2.0:1787893468.129340:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+13:18208:x1874741481858304:12345-192.168.202.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787893468.129507:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+13:18208:x1874741481858304:12345-192.168.202.35@tcp:503:mount.lustre.0 Request processed in 151us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893468.129516:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 144 00000100:00100000:2.0:1787893468.133623:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893468.133737:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481858432 00000100:00100000:0.0:1787893468.133748:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481858432 00000100:00100000:0.0:1787893468.133816:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 145 00000100:00100000:0.0:1787893468.133826:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+13:18214:x1874741481858432:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787893468.134042:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+13:18214:x1874741481858432:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 217us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893468.134052:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 145 00000100:00100000:0.0:1787893468.142322:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893468.144537:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481858560 00000100:00100000:2.0:1787893468.144551:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481858560 00000100:00100000:2.0:1787893468.144613:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 146 00000100:00100000:2.0:1787893468.144637:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+13:18214:x1874741481858560:12345-192.168.202.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893468.144798:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+13:18214:x1874741481858560:12345-192.168.202.35@tcp:502:llog_process_th.0 Request processed in 162us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893468.144807:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 146 00000100:00100000:2.0:1787893468.163144:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893468.163180:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893468.163224:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893468.163260:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893468.163705:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481859328 00000100:00100000:1.0:1787893468.163716:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481859328 00000100:00100000:1.0:1787893468.163779:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481859456 00000100:00100000:1.0:1787893468.163782:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481859456 00000100:00100000:1.0:1787893468.163809:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:1.0:1787893468.163819:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:2393:x1874741481859328:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893468.163835:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:2.0:1787893468.163843:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2393:x1874741481859456:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893468.163893:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2393:x1874741481859456:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 51us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893468.163900:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:0.0:1787893468.163921:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481859584 00000100:00100000:0.0:1787893468.163925:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481859584 00000100:00100000:0.0:1787893468.163954:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481859712 00000100:00100000:0.0:1787893468.163957:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481859712 00000100:00100000:0.0:1787893468.163974:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:0.0:1787893468.163982:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2393:x1874741481859584:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893468.165601:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:3.0:1787893468.165622:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2393:x1874741481859712:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893468.170368:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:2393:x1874741481859328:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 6536us (7220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893468.170383:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:0.0:1787893468.173388:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2393:x1874741481859584:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 9394us (10194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893468.173402:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:3.0:1787893468.181013:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2393:x1874741481859712:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 15389us (17739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893468.181029:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:3.0:1787893468.181130:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893468.181165:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893468.183157:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481858688 00000100:00100000:1.0:1787893468.183172:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481858688 00000100:00100000:1.0:1787893468.183231:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481858944 00000100:00100000:1.0:1787893468.183234:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481858944 00000100:00100000:1.0:1787893468.183262:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893468.183270:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1874741481858688:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787893468.183299:0:22764:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from dd12447e-462e-44ae-80f0-d0642d80e472@192.168.202.35@tcp t0 exp 0000000000000000 cur 712 last 0 00000020:00000080:1.0:1787893468.183339:0:22764:0:(genops.c:1385:class_connect()) connect: client dd12447e-462e-44ae-80f0-d0642d80e472, cookie 0x9232577658cf2b39 00000004:00100000:1.0:1787893468.183368:0:22764:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787893468.183486:0:22764:0:(import.c:65:import_set_state_nolock()) ffff9fc9fd1d7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893468.183575:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+6:2389:x1874741481858688:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 304us (2444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893468.183581:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893468.183598:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787893468.183610:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1874741481858944:12345-192.168.202.35@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787893468.183626:0:22764:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from dd12447e-462e-44ae-80f0-d0642d80e472@192.168.202.35@tcp t0 exp 0000000000000000 cur 712 last 0 00000020:00000080:1.0:1787893468.183646:0:22764:0:(genops.c:1385:class_connect()) connect: client dd12447e-462e-44ae-80f0-d0642d80e472, cookie 0x9232577658cf2b40 00000004:00100000:1.0:1787893468.183658:0:22764:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787893468.183701:0:22764:0:(import.c:65:import_set_state_nolock()) ffff9fc9fd1d4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893468.183727:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+6:2389:x1874741481858944:12345-192.168.202.35@tcp:38:mount.lustre.0 Request processed in 116us (2560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893468.183734:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:2.0:1787893468.193329:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893468.195148:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481859200 00000100:00100000:1.0:1787893468.195166:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481859200 00000100:00100000:1.0:1787893468.195265:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:1.0:1787893468.195277:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+6:18208:x1874741481859200:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787893468.195316:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00080000:2.0:1787893468.195377:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893468.195395:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+6:18208:x1874741481859200:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 120us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893468.195403:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:2.0:1787893468.200776:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893468.200834:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893468.200919:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481859072 00000100:00100000:3.0:1787893468.200929:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481859072 00000100:00100000:3.0:1787893468.200996:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481858816 00000100:00100000:3.0:1787893468.201000:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481858816 00000100:00100000:3.0:1787893468.201026:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:3.0:1787893468.201036:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:0:x1874741481859072:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787893468.201073:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787893468.201137:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:0:x1874741481859072:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 102us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893468.201144:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:3.0:1787893468.201173:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:3.0:1787893468.201179:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:0:x1874741481858816:12345-192.168.202.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787893468.201211:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787893468.201303:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:0:x1874741481858816:12345-192.168.202.35@tcp:41:mount.lustre.0 Request processed in 123us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893468.201309:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:3.0:1787893468.201400:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893468.201420:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481859840 00000100:00100000:3.0:1787893468.201425:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481859840 00000100:00100000:3.0:1787893468.201443:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:3.0:1787893468.201449:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:18208:x1874741481859840:12345-192.168.202.35@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787893468.201548:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:18208:x1874741481859840:12345-192.168.202.35@tcp:40:mount.lustre.0 Request processed in 98us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893468.201555:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00080000:2.0:1787893468.202077:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787893468.206261:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893468.206304:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893468.206339:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893468.206396:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481860224 00000100:00100000:1.0:1787893468.206405:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481860224 00000100:00100000:1.0:1787893468.206466:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:1.0:1787893468.206477:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd12447e-462e-44ae-80f0-d0642d80e472+6:18208:x1874741481860224:12345-192.168.202.35@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787893468.206556:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481859968 00000100:00100000:3.0:1787893468.206562:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481859968 00000100:00100000:1.0:1787893468.206578:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd12447e-462e-44ae-80f0-d0642d80e472+6:18208:x1874741481860224:12345-192.168.202.35@tcp:900:mount.lustre.0 Request processed in 104us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893468.206580:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481860096 00000100:00100000:3.0:1787893468.206582:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481860096 00000100:00100000:1.0:1787893468.206586:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:3.0:1787893468.206597:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787893468.206602:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874741481859968:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787893468.206628:0:24273:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dd12447e-462e-44ae-80f0-d0642d80e472@192.168.202.35@tcp t0 exp 0000000000000000 cur 712 last 0 00000020:00000080:3.0:1787893468.206654:0:24273:0:(genops.c:1385:class_connect()) connect: client dd12447e-462e-44ae-80f0-d0642d80e472, cookie 0x9232577658cf2b47 00002000:00100000:3.0:1787893468.206667:0:24273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd12447e-462e-44ae-80f0-d0642d80e472/ffff9fc8c7d19800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787893468.206677:0:24273:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787893468.206745:0:24273:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787893468.206787:0:24273:0:(import.c:65:import_set_state_nolock()) ffff9fc9c425e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787893468.206816:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:2389:x1874741481859968:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 212us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893468.206824:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787893468.206838:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787893468.206842:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1874741481860096:12345-192.168.202.35@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787893468.206858:0:24273:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from dd12447e-462e-44ae-80f0-d0642d80e472@192.168.202.35@tcp t0 exp 0000000000000000 cur 712 last 0 00000020:00000080:3.0:1787893468.206873:0:24273:0:(genops.c:1385:class_connect()) connect: client dd12447e-462e-44ae-80f0-d0642d80e472, cookie 0x9232577658cf2b4e 00002000:00100000:3.0:1787893468.206879:0:24273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd12447e-462e-44ae-80f0-d0642d80e472/ffff9fc9c5175000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787893468.206884:0:24273:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787893468.206942:0:24273:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787893468.206956:0:24273:0:(import.c:65:import_set_state_nolock()) ffff9fc9e7b5f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787893468.206977:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:2389:x1874741481860096:12345-192.168.202.35@tcp:8:mount.lustre.0 Request processed in 133us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893468.206983:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:2.0:1787893468.212350:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893468.212732:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481860352 00000100:00100000:0.0:1787893468.212742:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481860352 00000100:00100000:0.0:1787893468.212790:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:0.0:1787893468.212801:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd12447e-462e-44ae-80f0-d0642d80e472+6:18208:x1874741481860352:12345-192.168.202.35@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787893468.212883:0:22767:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787893468.212989:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd12447e-462e-44ae-80f0-d0642d80e472+6:18208:x1874741481860352:12345-192.168.202.35@tcp:33:mount.lustre.0 Request processed in 189us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893468.212997:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00010000:00010000:1.0:1787893468.273695:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893468.412235:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893468.412439:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481860480 00000100:00100000:3.0:1787893468.412536:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481860480 00000100:00100000:3.0:1787893468.412599:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:3.0:1787893468.412609:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:18237:x1874741481860480:12345-192.168.202.35@tcp:101:mkdir.0 00010000:00010000:3.0:1787893468.412629:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893468.412742:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2b55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fada7 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893468.412809:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893468.412838:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893468.412850:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893468.412896:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787893468.412899:0:22765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893468.412930:0:22765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893468.412955:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2b55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fada7 expref: 8 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893468.412972:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fada7 expref: 7 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893468.412980:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c6ebd400) 00010000:00010000:3.0:1787893468.412983:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893468.412986:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540000, rc 0) 00000100:00100000:3.0:1787893468.413309:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+7:18237:x1874741481860480:12345-192.168.202.35@tcp:101:mkdir.0 Request processed in 700us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893468.413317:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:1.0:1787893468.849708:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893468.849746:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493507328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893468.849835:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893468.849944:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493507328 00000100:00100000:2.0:1787893468.849952:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493507328 00000100:00080000:3.0:1787893468.849982:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893468.850084:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787893468.850101:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493507328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893468.850123:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893468.850166:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493507328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893468.850319:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493507328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893468.856562:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787893469.300113:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893469.362174:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893469.362199:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493507456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893469.362266:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893469.362317:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493507456 00000100:00100000:2.0:1787893469.362325:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493507456 00000100:00100000:2.0:1787893469.362384:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787893469.362393:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493507456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893469.362425:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787893469.362471:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493507456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893469.362478:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787893469.362819:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893469.362828:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493507584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893469.362856:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893469.363259:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493507584 00000100:00100000:1.0:1787893469.363265:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493507584 00000100:00100000:1.0:1787893469.363309:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787893469.363317:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493507584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893469.363344:0:23786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787893469.363397:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493507584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893469.363404:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787893469.363535:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9fa529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493507584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893469.364314:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493507456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893469.880715:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c67aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493507712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893469.880785:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893469.880859:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493507712 00000100:00100000:0.0:1787893469.880868:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493507712 00000100:00100000:0.0:1787893469.880947:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787893469.880958:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493507712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787893469.880986:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1787893469.883542:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893469.884801:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493507712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3833us (4003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893469.884815:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787893469.885482:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c67aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493507712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787893470.323076:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893470.902234:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afca6d2b-351c-4adb-95b2-d9dd13744042:3633:1874741493507840:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902309:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902352:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493508352:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902379:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902398:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493508864:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902418:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902433:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493509376:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902455:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902479:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787893470.902485:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493508224:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902535:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902554:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493508736:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902573:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902588:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493509248:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902609:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902634:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493507968:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902658:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902675:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493508480:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902693:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902710:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493508992:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902731:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902742:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787893470.902758:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493508096:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902780:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902797:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493508608:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902816:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902832:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493509120:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.902852:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893470.902879:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493507840 00000100:00100000:3.0:1787893470.902899:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493507840 00000100:00100000:3.0:1787893470.902949:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787893470.902956:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:3633:x1874741493507840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903007:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:3633:x1874741493507840:12345-0@lo:400:kworker.0 Request processed in 50us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903014:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787893470.903048:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493508352 00000100:00100000:3.0:1787893470.903052:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493508352 00000100:00100000:3.0:1787893470.903071:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493508864 00000100:00100000:3.0:1787893470.903073:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493508864 00000100:00100000:3.0:1787893470.903087:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493509376 00000100:00100000:3.0:1787893470.903089:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493509376 00000100:00100000:3.0:1787893470.903112:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493509248 00000100:00100000:3.0:1787893470.903114:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493509248 00000100:00100000:3.0:1787893470.903125:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493508992 00000100:00100000:3.0:1787893470.903127:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493508992 00000100:00100000:3.0:1787893470.903137:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493509120 00000100:00100000:3.0:1787893470.903140:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493509120 00000100:00100000:3.0:1787893470.903155:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787893470.903160:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493508352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903193:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874741493508352:12345-0@lo:400:kworker.0 Request processed in 33us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903209:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787893470.903221:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787893470.903227:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493508864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903253:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874741493508864:12345-0@lo:400:kworker.0 Request processed in 27us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903258:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787893470.903268:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787893470.903273:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493509376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903297:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874741493509376:12345-0@lo:400:kworker.0 Request processed in 24us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903302:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787893470.903313:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787893470.903318:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493509248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903343:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493509248:12345-0@lo:400:kworker.0 Request processed in 25us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903349:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787893470.903361:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787893470.903367:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493508992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903398:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493508992:12345-0@lo:400:kworker.0 Request processed in 32us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903406:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787893470.903418:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787893470.903423:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493509120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903447:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3630:x1874741493509120:12345-0@lo:400:kworker.0 Request processed in 25us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903460:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787893470.903486:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493508224 00000100:00100000:3.0:1787893470.903515:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493508224 00000100:00100000:3.0:1787893470.903536:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493508736 00000100:00100000:3.0:1787893470.903538:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493508736 00000100:00100000:3.0:1787893470.903548:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493508096 00000100:00100000:3.0:1787893470.903551:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493508096 00000100:00100000:3.0:1787893470.903559:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493508608 00000100:00100000:3.0:1787893470.903562:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493508608 00000100:00100000:3.0:1787893470.903573:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787893470.903579:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493508224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903617:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493508224:12345-0@lo:400:kworker.0 Request processed in 38us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903622:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787893470.903633:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787893470.903638:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493508736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903662:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493508736:12345-0@lo:400:kworker.0 Request processed in 24us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903668:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787893470.903678:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787893470.903684:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493508096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903710:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493508096:12345-0@lo:400:kworker.0 Request processed in 26us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903715:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787893470.903725:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787893470.903731:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493508608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903769:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493508608:12345-0@lo:400:kworker.0 Request processed in 38us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903775:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787893470.903800:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493507968 00000100:00100000:3.0:1787893470.903804:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493507968 00000100:00100000:3.0:1787893470.903827:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493508480 00000100:00100000:3.0:1787893470.903830:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493508480 00000100:00100000:3.0:1787893470.903843:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787893470.903848:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493507968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903878:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493507968:12345-0@lo:400:kworker.0 Request processed in 30us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903899:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787893470.903910:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787893470.903916:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493508480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.903943:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493508480:12345-0@lo:400:kworker.0 Request processed in 27us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893470.903949:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787893470.903976:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893470.903980:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893470.903982:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893470.903984:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893470.904018:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493508096:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.904029:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493508608:0@lo:400:kworker.0 00010000:00080000:3.0:1787893470.904041:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbdd500 x1874741493509120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893470.904051:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3630:1874741493509120:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.904071:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493507968:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.904080:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493508480:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.904088:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493508992:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.904129:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493508224:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.904138:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1787893470.904149:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493508736:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.904160:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493509248:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.904168:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afca6d2b-351c-4adb-95b2-d9dd13744042:3633:1874741493507840:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.904177:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874741493508352:0@lo:400:kworker.0 00000100:00100000:3.0:1787893470.904186:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874741493508864:0@lo:400:kworker.0 00010000:00080000:3.0:1787893470.904195:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9c3e6e300 x1874741493509376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893470.904204:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9c3e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3633:1874741493509376:0@lo:400:kworker.0 00000100:00100000:1.0:1787893470.907672:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493509632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787893470.907748:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893470.907793:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893470.907800:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893470.907824:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893470.907859:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493509632 00000100:00100000:1.0:1787893470.907867:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493509632 00000100:00100000:1.0:1787893470.907915:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493509504 00000100:00100000:1.0:1787893470.907918:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493509504 00000100:00100000:1.0:1787893470.907944:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787893470.907953:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493509632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893470.907991:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787893470.908037:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493509632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893470.908045:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787893470.908061:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787893470.908068:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493509504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893470.908077:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787893470.908101:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3631:x1874741493509504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893470.908107:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787893470.908148:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893470.908161:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493509632:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1787893470.913046:0:24267:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd12447e-462e-44ae-80f0-d0642d80e472 00000001:00100000:1.0:1787893470.913057:0:24267:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd6f19be-6c98-4c86-964a-533d4d057bbd 00000001:00100000:1.0:1787893470.913074:0:22743:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd12447e-462e-44ae-80f0-d0642d80e472 00000001:00100000:1.0:1787893470.913081:0:22743:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd6f19be-6c98-4c86-964a-533d4d057bbd 00000001:00100000:3.0:1787893470.916158:0:23497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dd12447e-462e-44ae-80f0-d0642d80e472 00000001:00100000:3.0:1787893470.916177:0:23497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dd6f19be-6c98-4c86-964a-533d4d057bbd 00010000:00010000:3.0:1787893471.349361:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787893471.441707:0:25644:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:1.0:1787893471.731245:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787893472.371172:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893473.306796:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893473.306842:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893473.306885:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893473.306905:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893473.306933:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893473.306962:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893473.306980:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893473.306999:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893473.307026:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893473.307055:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481860608 00000100:00100000:2.0:1787893473.307065:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481860608 00000100:00100000:2.0:1787893473.307116:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00100000:2.0:1787893473.307126:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+13:2392:x1874741481860608:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893473.307198:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+13:2392:x1874741481860608:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 72us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893473.307220:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 148 00000100:00100000:1.0:1787893473.307422:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481860992 00000100:00100000:1.0:1787893473.307429:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481860992 00000100:00100000:1.0:1787893473.307479:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481861504 00000100:00100000:1.0:1787893473.307483:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481861504 00000100:00100000:1.0:1787893473.307535:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481861120 00000100:00100000:1.0:1787893473.307539:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481861120 00000100:00100000:1.0:1787893473.307556:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481861632 00000100:00100000:1.0:1787893473.307558:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481861632 00000100:00100000:1.0:1787893473.307588:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:1.0:1787893473.307596:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481860992:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893473.307638:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481860992:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 41us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893473.307645:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:1.0:1787893473.307663:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893473.307669:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd12447e-462e-44ae-80f0-d0642d80e472+5:2392:x1874741481861504:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893473.307690:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd12447e-462e-44ae-80f0-d0642d80e472+5:2392:x1874741481861504:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893473.307697:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:1.0:1787893473.307712:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787893473.307717:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481861120:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893473.307738:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481861120:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 21us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893473.307743:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787893473.307754:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:1.0:1787893473.307759:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:2392:x1874741481861632:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893473.307779:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:2392:x1874741481861632:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 20us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893473.307786:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:3.0:1787893473.308252:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481860736 00000100:00100000:3.0:1787893473.308258:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481860736 00000100:00100000:3.0:1787893473.308293:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481861248 00000100:00100000:3.0:1787893473.308296:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481861248 00000100:00100000:3.0:1787893473.308310:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481860864 00000100:00100000:3.0:1787893473.308318:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481860864 00000100:00100000:3.0:1787893473.308336:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481861376 00000100:00100000:3.0:1787893473.308339:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481861376 00000100:00100000:3.0:1787893473.308354:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:3.0:1787893473.308361:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2392:x1874741481860736:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893473.308412:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2392:x1874741481860736:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 51us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893473.308419:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:3.0:1787893473.308432:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:3.0:1787893473.308438:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+6:2392:x1874741481861248:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893473.308462:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+6:2392:x1874741481861248:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 24us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893473.308468:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:3.0:1787893473.308480:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:3.0:1787893473.308486:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481860864:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893473.308539:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481860864:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 54us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893473.308544:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:3.0:1787893473.308555:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:3.0:1787893473.308561:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+5:2392:x1874741481861376:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893473.308583:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+5:2392:x1874741481861376:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 23us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893473.308588:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00080000:2.0:1787893473.308672:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893473.308676:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893473.308678:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787893473.308681:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787893473.396165:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893473.972226:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493509760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787893473.972304:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893473.973184:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493509760 00000100:00100000:1.0:1787893473.973194:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493509760 00000100:00100000:1.0:1787893473.973263:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893473.973273:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493509760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787893473.973310:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787893473.973370:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493509760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893473.973379:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893473.973433:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493509760:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787893473.973826:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787893473.975656:0:25088:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd12447e-462e-44ae-80f0-d0642d80e472 00010000:00010000:1.0:1787893474.418205:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893474.481860:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893474.481884:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493509888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787893474.481950:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893474.482341:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493509888 00000100:00100000:3.0:1787893474.482350:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493509888 00000100:00100000:3.0:1787893474.482398:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787893474.482409:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493509888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787893474.482445:0:23786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787893474.484807:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493510016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787893474.488846:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493509888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6429us (6886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893474.488871:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787893474.492396:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493509888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787893474.509547:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893474.509682:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493510016 00000100:00100000:2.0:1787893474.509691:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493510016 00000100:00100000:2.0:1787893474.509744:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787893474.509755:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493510016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787893474.509790:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787893474.509847:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493510016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893474.509867:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787893474.509913:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493510016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787893474.993920:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893475.004129:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493510144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893475.004204:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893475.005142:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493510144 00000100:00100000:3.0:1787893475.005153:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493510144 00000100:00100000:3.0:1787893475.005220:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787893475.005231:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493510144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893475.005254:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787893475.005325:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493510144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893475.005331:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787893475.005455:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893475.005513:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493510144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787893475.441687:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787893475.536386:0:25791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca84b8c20 20000000:00000080:3.0:1787893475.536402:0:25791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc9d0ae1000 uarg=0000000000000000 20000000:01000000:3.0:1787893475.536451:0:25791:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787893475.536456:0:25791:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787893475.536461:0:25791:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787893475.537077:0:25792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1787893475.537240:0:25791:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787893475.546610:0:25791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787893475.546644:0:25791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.546683:0:25791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c67e0a00/0x9232577658cf27c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf27b9 expref: 23 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.546692:0:25791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9fe541600/0x9232577658cf27ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf27c7 expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.546699:0:25791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9edb30200/0x9232577658cf280d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2806 expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.546706:0:25791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf298e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2987 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.546716:0:25791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2af3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad06 expref: 12 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.547025:0:25791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc9dd729600/0x9232577658cf2b32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad76 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.547037:0:25791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.547080:0:25791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9dd729600/0x9232577658cf2b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad76 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.547096:0:25791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9dd729600/0x9232577658cf2b32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad76 expref: 12 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893475.547111:0:25791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493510272:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893475.547219:0:25791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad06 expref: 12 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.547236:0:25791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad06 expref: 12 pid: 22758 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893475.547246:0:25791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493510400:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893475.547276:0:25791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf298e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf2987 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.547285:0:25791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf298e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf2987 expref: 23 pid: 22755 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893475.547294:0:25791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb68e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493510528:0@lo:104: 00000100:00100000:1.0:1787893475.551149:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893475.551193:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481861760 00000100:00100000:0.0:1787893475.551202:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481861760 00010000:00010000:0.0:1787893475.551242:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9dd729600/0x9232577658cf2b32 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad76 expref: 13 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893475.551302:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:0.0:1787893475.551313:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d609832-c190-4f05-b711-9e10bcf3662d+13:2390:x1874741481861760:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893475.551328:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893475.551334:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9dd729600/0x9232577658cf2b32 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad76 expref: 13 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.551347:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9dd729600/0x9232577658cf2b32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad76 expref: 13 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.551368:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893475.551423:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d609832-c190-4f05-b711-9e10bcf3662d+13:2390:x1874741481861760:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 112us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893475.551430:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:2.0:1787893475.551469:0:25791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787893475.551552:0:25791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9edb30200/0x9232577658cf280d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf2806 expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.551563:0:25791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9edb30200/0x9232577658cf280d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf2806 expref: 23 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893475.551577:0:25791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493510656:0@lo:104: 00000100:00100000:2.0:1787893475.551600:0:25791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893475.551622:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493510528 00000100:00100000:2.0:1787893475.551626:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493510528 00000100:00100000:2.0:1787893475.551648:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493510656 00000100:00100000:2.0:1787893475.551656:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493510656 00000100:00100000:2.0:1787893475.551672:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893475.551677:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+4:25791:x1874741493510528:12345-0@lo:104: 00010000:00010000:2.0:1787893475.551689:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.551726:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787893475.551731:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+4:25791:x1874741493510528:12345-0@lo:104: Request processed in 54us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893475.551737:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893475.551751:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787893475.551757:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+3:25791:x1874741493510656:12345-0@lo:104: 00010000:00010000:2.0:1787893475.551764:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.551803:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787893475.551809:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+3:25791:x1874741493510656:12345-0@lo:104: Request processed in 52us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893475.551815:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787893475.551831:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893475.551835:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893475.551837:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.551849:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.551853:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728200 already unused, calling callback (ffffffffc129fc20) 00010000:00010000:0.0:1787893475.551856:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1e00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:2.0:1787893475.551858:0:22752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893475.551859:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.551868:0:22752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.551868:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893475.551875:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893475.551885:0:22752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893475.551891:0:22752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787893475.551891:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787893475.551914:0:22752:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.551921:0:22752:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893475.551939:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.551946:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9dd728200/0x9232577658cf2987 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf298e expref: -99 pid: 25087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.551960:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893475.551962:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893475.551963:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893475.551986:0:25791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc9fe541600/0x9232577658cf27ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf27c7 expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.551995:0:25791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc9fe541600/0x9232577658cf27ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf27c7 expref: 23 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893475.552004:0:25791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493510912:0@lo:104: 00000100:00100000:2.0:1787893475.552026:0:25791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787893475.552067:0:25791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc8c67e0a00/0x9232577658cf27c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9232577658cf27b9 expref: 23 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.552076:0:25791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc8c67e0a00/0x9232577658cf27c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9232577658cf27b9 expref: 23 pid: 22758 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893475.552091:0:25791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493511040:0@lo:104: 00000100:00100000:3.0:1787893475.552104:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493510912 00000100:00100000:3.0:1787893475.552109:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493510912 00000100:00100000:2.0:1787893475.552112:0:25791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893475.552127:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493511040 00000100:00100000:3.0:1787893475.552130:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493511040 00000100:00100000:2.0:1787893475.552131:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787893475.552137:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+4:25791:x1874741493510912:12345-0@lo:104: 00010000:00010000:2.0:1787893475.552144:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.552652:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787893475.552660:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+4:25791:x1874741493510912:12345-0@lo:104: Request processed in 522us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893475.552667:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787893475.552684:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787893475.552691:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+3:25791:x1874741493511040:12345-0@lo:104: 00010000:00010000:2.0:1787893475.552700:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.558904:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.558930:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893475.558945:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559021:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf280d expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559044:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893475.559048:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559055:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540c00 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787893475.559060:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559069:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893475.559076:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893475.559082:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787893475.559106:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559112:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893475.559162:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559170:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc9fe540c00/0x9232577658cf27c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf27ce expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559179:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893475.559182:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559188:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c7c7e200 already unused, calling callback (ffffffffc129fc20) 10000000:00010000:0.0:1787893475.559191:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559198:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893475.559204:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893475.559209:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787893475.559223:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559230:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893475.559236:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559241:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.135@tcp lock: ffff9fc8c7c7e200/0x9232577658cf27b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9232577658cf27c0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.559267:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893475.559269:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893475.559349:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afca6d2b-351c-4adb-95b2-d9dd13744042:3631:1874741493511424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893475.559417:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893475.559472:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893475.559478:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afca6d2b-351c-4adb-95b2-d9dd13744042:3631:1874741493511296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893475.559520:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787893475.559536:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893475.559549:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493510784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893475.559562:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493511424 00000100:00100000:3.0:1787893475.559569:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493511424 00000100:00100000:1.0:1787893475.559570:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893475.559585:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893475.559589:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493511168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893475.559598:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c67e0a00/0x9232577658cf27c0 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf27b9 expref: 24 pid: 22758 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893475.559609:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787893475.559660:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787893475.559670:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+3:25791:x1874741493511040:12345-0@lo:104: Request processed in 6978us (7555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893475.559678:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787893475.559705:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893475.559720:0:25791:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57540 going to sleep for 11 seconds 00010000:00010000:2.0:1787893475.559745:0:25791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9dd729600/0x9232577658cf2b32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad76 expref: 12 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893475.559757:0:25791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493510272:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893475.559777:0:25791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493510400:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893475.559787:0:25791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb68e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493510528:0@lo:104: 00000100:00100000:2.0:1787893475.559795:0:25791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493510656:0@lo:104: 00000100:00100000:2.0:1787893475.559803:0:25791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493510912:0@lo:104: 00000100:00100000:2.0:1787893475.559810:0:25791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25791:1874741493511040:0@lo:104: 00010000:00010000:2.0:1787893475.559836:0:25791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.562416:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893475.562639:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493511296 00000100:00100000:3.0:1787893475.562650:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493511296 00010000:00010000:3.0:1787893475.562689:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9fe541600/0x9232577658cf27ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf27c7 expref: 25 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893475.562707:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493510784 00000100:00100000:3.0:1787893475.562709:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493510784 00010000:00010000:3.0:1787893475.562718:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf298e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2987 expref: 26 pid: 22755 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893475.562761:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493511168 00000100:00100000:3.0:1787893475.562765:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493511168 00010000:00010000:3.0:1787893475.562779:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc9edb30200/0x9232577658cf280d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2806 expref: 27 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893475.562793:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787893475.562801:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afca6d2b-351c-4adb-95b2-d9dd13744042+27:3631:x1874741493511424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893475.562814:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893475.562821:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c67e0a00/0x9232577658cf27c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf27b9 expref: 27 pid: 22758 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.562831:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c67e0a00/0x9232577658cf27c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf27b9 expref: 27 pid: 22758 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.562858:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c67e0a00/0x9232577658cf27c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf27b9 expref: 27 pid: 22758 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893475.562872:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893475.569063:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893475.569087:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+26:3631:x1874741493511296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893475.569123:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893475.569134:0:22749:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9fe541600/0x9232577658cf27ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf27c7 expref: 26 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893475.569149:0:22749:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9fe541600/0x9232577658cf27ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf27c7 expref: 26 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893475.569169:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541600/0x9232577658cf27ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf27c7 expref: 26 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893475.569181:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893475.572581:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893475.574203:0:22748:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787893475.574222:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1787893475.574544:0:23919:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787893475.574555:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481861888 00000100:00100000:0.0:1787893475.574565:0:23919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481861888 00010000:00010000:0.0:1787893475.574601:0:23919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad06 expref: 12 pid: 22758 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893475.574628:0:23919:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787893475.574637:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787893475.574646:0:23919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afca6d2b-351c-4adb-95b2-d9dd13744042+25:3632:x1874741493510784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893475.574660:0:23919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893475.574667:0:23919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf298e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2987 expref: 25 pid: 22755 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.574678:0:23919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf298e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf2987 expref: 25 pid: 22755 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.574695:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c7c7e000/0x9232577658cf298e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf2987 expref: 25 pid: 22755 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.574712:0:23919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893475.574808:0:23919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afca6d2b-351c-4adb-95b2-d9dd13744042+24:3632:x1874741493510784:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (15235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893475.574815:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787893475.574833:0:23919:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787893475.574859:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787893475.574866:0:23919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c759e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afca6d2b-351c-4adb-95b2-d9dd13744042+23:3632:x1874741493511168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893475.574874:0:23919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893475.574880:0:23919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc9edb30200/0x9232577658cf280d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9232577658cf2806 expref: 23 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.574887:0:23919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc9edb30200/0x9232577658cf280d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9232577658cf2806 expref: 23 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.574897:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9edb30200/0x9232577658cf280d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9232577658cf2806 expref: 23 pid: 22757 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.574906:0:23919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893475.575120:0:23919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c759e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afca6d2b-351c-4adb-95b2-d9dd13744042+22:3632:x1874741493511168:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (15509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893475.575127:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787893475.575139:0:23919:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787893475.575145:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:0.0:1787893475.575151:0:23919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7d609832-c190-4f05-b711-9e10bcf3662d+12:2391:x1874741481861888:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893475.575159:0:23919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893475.575164:0:23919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad06 expref: 12 pid: 22758 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575174:0:23919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad06 expref: 12 pid: 22758 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575184:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc8c67e1c00/0x9232577658cf2af3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad06 expref: 12 pid: 22758 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575205:0:23919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575213:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575226:0:23919:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575233:0:23919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575240:0:23919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575246:0:23919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575252:0:23919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe541000 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:0.0:1787893475.575256:0:23919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575264:0:23919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575277:0:23919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893475.575287:0:23919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893475.575331:0:23919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7d609832-c190-4f05-b711-9e10bcf3662d+11:2391:x1874741481861888:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 179us (2762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893475.575344:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:3.0:1787893475.575609:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afca6d2b-351c-4adb-95b2-d9dd13744042+21:3631:x1874741493511424:12345-0@lo:103:ldlm_bl.0 Request processed in 12807us (16190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893475.575617:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787893475.575773:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afca6d2b-351c-4adb-95b2-d9dd13744042:3631:1874741493511424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893475.576459:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493511168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893475.576469:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:afca6d2b-351c-4adb-95b2-d9dd13744042:3632:1874741493510784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893475.576515:0:25791:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.576526:0:25791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893475.576534:0:25791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc9fe541000/0x9232577658cf2b63 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893475.581589:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afca6d2b-351c-4adb-95b2-d9dd13744042+20:3631:x1874741493511296:12345-0@lo:103:ldlm_bl.0 Request processed in 12506us (22060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893475.581604:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000040:00080000:0.0:1787893475.582167:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787893475.592758:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:afca6d2b-351c-4adb-95b2-d9dd13744042:3631:1874741493511296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893476.018244:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893476.018266:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493511552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893476.018349:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893476.018941:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493511552 00000100:00100000:3.0:1787893476.018950:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493511552 00000100:00100000:3.0:1787893476.019003:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787893476.019015:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493511552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893476.019045:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787893476.019108:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493511552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893476.019116:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787893476.019224:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893476.019265:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493511552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893476.019606:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493511808:0@lo:400:kworker.0 00000100:00100000:0.0:1787893476.019642:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893476.019669:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493512320:0@lo:400:kworker.0 00000100:00100000:0.0:1787893476.019691:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893476.019706:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493512832:0@lo:400:kworker.0 00000100:00100000:0.0:1787893476.019729:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893476.019748:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787893476.019753:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493511936:0@lo:400:kworker.0 00000100:00100000:0.0:1787893476.019772:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893476.019786:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e711dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493512448:0@lo:400:kworker.0 00000100:00100000:0.0:1787893476.019803:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893476.019815:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493512960:0@lo:400:kworker.0 00000100:00100000:0.0:1787893476.019845:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893476.020187:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493511808 00000100:00100000:1.0:1787893476.020194:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493511808 00000100:00100000:1.0:1787893476.020233:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493512320 00000100:00100000:1.0:1787893476.020235:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493512320 00000100:00100000:1.0:1787893476.020257:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787893476.020264:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493511808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893476.020317:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493511808:12345-0@lo:400:kworker.0 Request processed in 53us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893476.020324:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787893476.020336:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787893476.020342:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493512320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893476.020363:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3630:x1874741493512320:12345-0@lo:400:kworker.0 Request processed in 22us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893476.020369:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787893476.020898:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493512064:0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.020929:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893476.020959:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493512576:0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.020978:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893476.020986:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493513088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787893476.021002:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893476.021024:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787893476.021030:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493511680:0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.021046:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893476.021061:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493512192:0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.021078:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893476.021091:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493512704:0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.021106:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893476.021126:0:25379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493512192 00000100:00100000:3.0:1787893476.021130:0:25379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493512192 00000100:00100000:3.0:1787893476.021153:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787893476.021160:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493512192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.021193:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493512192:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893476.021199:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787893476.021360:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893476.021365:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893476.021391:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493511808:0@lo:400:kworker.0 00000100:00100000:0.0:1787893476.021408:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3630:1874741493512320:0@lo:400:kworker.0 00000100:00100000:0.0:1787893476.021452:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493512832 00000100:00100000:0.0:1787893476.021456:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493512832 00000100:00100000:0.0:1787893476.021531:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493511936 00000100:00100000:0.0:1787893476.021534:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493511936 00000100:00100000:0.0:1787893476.021546:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493512448 00000100:00100000:0.0:1787893476.021549:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493512448 00000100:00100000:0.0:1787893476.021557:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493512960 00000100:00100000:0.0:1787893476.021559:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493512960 00000100:00100000:0.0:1787893476.021568:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493512576 00000100:00100000:0.0:1787893476.021569:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493512576 00000100:00100000:3.0:1787893476.021726:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493512064 00000100:00100000:3.0:1787893476.021730:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493512064 00000100:00100000:3.0:1787893476.021754:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493511680 00000100:00100000:3.0:1787893476.021764:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493511680 00000100:00100000:3.0:1787893476.021779:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787893476.021785:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493512064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.021823:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493512064:12345-0@lo:400:kworker.0 Request processed in 37us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893476.021829:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787893476.021852:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787893476.021859:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493511680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.021884:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493511680:12345-0@lo:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893476.021889:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787893476.021913:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493511680:0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.021923:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493512192:0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.021931:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493512064:0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.021964:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787893476.021970:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493512832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.022000:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3630:x1874741493512832:12345-0@lo:400:kworker.0 Request processed in 31us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893476.022005:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787893476.022059:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493513088 00000100:00100000:1.0:1787893476.022062:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493513088 00000100:00100000:1.0:1787893476.022088:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787893476.022093:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493513088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893476.022106:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787893476.022136:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3632:x1874741493513088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893476.022141:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787893476.022169:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3632:1874741493513088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893476.022215:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493512704 00000100:00100000:0.0:1787893476.022219:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493512704 00000100:00100000:0.0:1787893476.022239:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787893476.022243:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493511936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893476.022273:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493511936:12345-0@lo:400:kworker.0 Request processed in 29us (2500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893476.022277:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787893476.022362:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787893476.022371:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493512448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893476.022404:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493512448:12345-0@lo:400:kworker.0 Request processed in 36us (2601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893476.022411:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787893476.022705:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787893476.022714:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493512960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.022746:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493512960:12345-0@lo:400:kworker.0 Request processed in 35us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893476.022751:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787893476.022773:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787893476.022779:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493512576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.022809:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1874741493512576:12345-0@lo:400:kworker.0 Request processed in 31us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893476.022815:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787893476.022826:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787893476.022831:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493512704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.022869:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1874741493512704:12345-0@lo:400:kworker.0 Request processed in 38us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893476.022875:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1787893476.022918:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787893476.022922:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893476.022948:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493511936:0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.022959:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e711dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493512448:0@lo:400:kworker.0 00010000:00080000:3.0:1787893476.022972:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb7ea00 x1874741493512960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893476.022982:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493512960:0@lo:400:kworker.0 00000100:00100000:3.0:1787893476.022992:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3630:1874741493512832:0@lo:400:kworker.0 00010000:00080000:1.0:1787893476.023750:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffb7c380 x1874741493512704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893476.023761:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3632:1874741493512704:0@lo:400:kworker.0 00000100:00100000:1.0:1787893476.023772:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3632:1874741493512576:0@lo:400:kworker.0 00010000:00010000:3.0:1787893476.465698:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787893477.105618:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787893477.105625:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc8c7d94000 from 13 10000000:01000000:0.0:1787893477.105631:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787893477.105679:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2b6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.105690:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2b6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.105702:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2b6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893477.105727:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787893477.105809:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893477.105868:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c108e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787893477.105993:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493513216 00000100:00100000:3.0:1787893477.106001:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493513216 00000100:00100000:3.0:1787893477.106064:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787893477.106076:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+20:22761:x1874741493513216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893477.106089:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893477.106111:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540600/0x9232577658cf2b71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2b6a expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.106136:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540600/0x9232577658cf2b71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2b6a expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.106147:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540600/0x9232577658cf2b71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2b6a expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.106157:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540600, rc 0) 00000100:00100000:3.0:1787893477.106204:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+21:22761:x1874741493513216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.106222:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787893477.106314:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893477.106328:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2b6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b71 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.106338:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2b6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf2b71 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893477.106396:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893477.106420:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893477.106443:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c108e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787893477.106691:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493513344 00000100:00100000:2.0:1787893477.106705:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493513344 00000100:00100000:2.0:1787893477.106744:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787893477.106750:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:22761:x1874741493513344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893477.106898:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+21:22761:x1874741493513344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893477.106905:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787893477.106984:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893477.107009:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893477.107049:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893477.107081:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c108e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787893477.107149:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493513472 00000100:00100000:3.0:1787893477.107153:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493513472 00000100:00100000:3.0:1787893477.107184:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787893477.107191:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:22761:x1874741493513472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.107284:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:22761:x1874741493513472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.107291:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787893477.107330:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787893477.107990:0:25806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787893477.108052:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787893477.108069:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787893477.108077:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2b6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b71 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.108086:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1e00/0x9232577658cf2b6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b71 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893477.108103:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787893477.108106:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9e78d7800 from 13 10000000:01000000:3.0:1787893477.108108:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787893477.108131:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541200/0x9232577658cf2b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.108139:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541200/0x9232577658cf2b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.108147:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541200/0x9232577658cf2b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893477.108160:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.108192:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893477.108212:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57900 going to sleep for 11 seconds 00000100:00100000:3.0:1787893477.108223:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493513600 00000100:00100000:3.0:1787893477.108226:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493513600 00000100:00100000:3.0:1787893477.108247:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787893477.108253:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+21:22761:x1874741493513600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893477.108262:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893477.108271:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf2b7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2b78 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.108289:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf2b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2b78 expref: 22 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.108298:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541a00/0x9232577658cf2b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2b78 expref: 22 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.108316:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541a00, rc 0) 00000100:00100000:3.0:1787893477.108346:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+22:22761:x1874741493513600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.108352:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787893477.108382:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893477.108394:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541200/0x9232577658cf2b78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b7f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.108401:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541200/0x9232577658cf2b78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf2b7f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893477.108442:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.108465:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893477.108478:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57900 going to sleep for 11 seconds 00000100:00100000:3.0:1787893477.108512:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493513728 00000100:00100000:3.0:1787893477.108515:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493513728 00000100:00100000:3.0:1787893477.108534:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787893477.108540:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+22:22761:x1874741493513728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.108621:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+22:22761:x1874741493513728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.108628:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787893477.108655:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.108678:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.108712:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893477.108737:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c7d57900 going to sleep for 11 seconds 00000100:00100000:3.0:1787893477.108747:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493513856 00000100:00100000:3.0:1787893477.108751:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493513856 00000100:00100000:3.0:1787893477.108767:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787893477.108771:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+22:22761:x1874741493513856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.108850:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+22:22761:x1874741493513856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.108857:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787893477.108896:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787893477.109596:0:25807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787893477.109655:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787893477.109668:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787893477.109675:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541200/0x9232577658cf2b78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b7f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.109684:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541200/0x9232577658cf2b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b7f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893477.109692:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787893477.109694:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9ffc1a000 from 13 10000000:01000000:3.0:1787893477.109697:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787893477.109718:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541400/0x9232577658cf2b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.109726:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541400/0x9232577658cf2b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.109734:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541400/0x9232577658cf2b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893477.109759:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.109795:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893477.109820:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e7016000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893477.109846:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493513984 00000100:00100000:3.0:1787893477.109850:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493513984 00000100:00100000:3.0:1787893477.109876:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787893477.109883:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa3f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+22:22761:x1874741493513984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893477.109892:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893477.109903:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe540c00/0x9232577658cf2b8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2b86 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.109921:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe540c00/0x9232577658cf2b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2b86 expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.109931:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe540c00/0x9232577658cf2b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2b86 expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.109938:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe540c00, rc 0) 00000100:00100000:3.0:1787893477.109969:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa3f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:22761:x1874741493513984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.109975:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787893477.110005:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493513984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893477.110017:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541400/0x9232577658cf2b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b8d expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.110026:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541400/0x9232577658cf2b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf2b8d expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893477.110076:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493514112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.110103:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893477.110116:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e7016000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893477.110127:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493514112 00000100:00100000:3.0:1787893477.110131:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493514112 00000100:00100000:3.0:1787893477.110147:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787893477.110152:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:22761:x1874741493514112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.110243:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:22761:x1874741493514112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.110249:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787893477.110274:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493514112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.110297:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493514240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.110332:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893477.110345:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e7016000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893477.110357:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493514240 00000100:00100000:3.0:1787893477.110360:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493514240 00000100:00100000:3.0:1787893477.110375:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787893477.110381:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:22761:x1874741493514240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.110441:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:22761:x1874741493514240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.110447:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787893477.110478:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493514240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787893477.117005:0:25808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787893477.119263:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787893477.119302:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787893477.119315:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541400/0x9232577658cf2b86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b8d expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.119328:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc9fe541400/0x9232577658cf2b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b8d expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893477.119339:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787893477.119343:0:22761:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc9c425c800 from 13 10000000:01000000:0.0:1787893477.119346:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787893477.119405:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1c00/0x9232577658cf2b94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.119413:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1c00/0x9232577658cf2b94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.119426:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1c00/0x9232577658cf2b94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893477.119452:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493514368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787893477.119549:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893477.119592:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c5d4a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893477.120135:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493514368 00000100:00100000:3.0:1787893477.120145:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493514368 00000100:00100000:3.0:1787893477.120200:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787893477.120220:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+23:22761:x1874741493514368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893477.120234:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893477.120247:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc9fe541600/0x9232577658cf2b9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9232577658cf2b94 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.120269:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc9fe541600/0x9232577658cf2b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9232577658cf2b94 expref: 24 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.120280:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc9fe541600/0x9232577658cf2b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9232577658cf2b94 expref: 24 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.120289:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9fe541600, rc 0) 00000100:00100000:3.0:1787893477.120347:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afca6d2b-351c-4adb-95b2-d9dd13744042+24:22761:x1874741493514368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.120353:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787893477.120531:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493514368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893477.120548:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1c00/0x9232577658cf2b94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b9b expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893477.120558:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1c00/0x9232577658cf2b94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9232577658cf2b9b expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893477.120618:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493514496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893477.120647:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893477.120682:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c77a5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893477.120746:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493514496 00000100:00100000:2.0:1787893477.120752:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493514496 00000100:00100000:2.0:1787893477.120777:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787893477.120783:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:22761:x1874741493514496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893477.120905:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:22761:x1874741493514496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893477.120912:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787893477.121031:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493514496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893477.121058:0:22761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493514624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893477.121102:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893477.121126:0:22761:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c77a5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893477.121170:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493514624 00000100:00100000:2.0:1787893477.121174:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493514624 00000100:00100000:2.0:1787893477.121189:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787893477.121193:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:22761:x1874741493514624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893477.121280:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afca6d2b-351c-4adb-95b2-d9dd13744042+24:22761:x1874741493514624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893477.121287:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787893477.121414:0:22761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:afca6d2b-351c-4adb-95b2-d9dd13744042:22761:1874741493514624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787893477.122410:0:25809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787893477.123048:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787893477.123074:0:22761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787893477.123084:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1c00/0x9232577658cf2b94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b9b expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.123095:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.135@tcp lock: ffff9fc8c67e1c00/0x9232577658cf2b94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9232577658cf2b9b expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893477.442299:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893477.442369:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481862016 00000100:00100000:3.0:1787893477.442379:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481862016 00000100:00100000:3.0:1787893477.442441:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787893477.442450:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:18705:x1874741481862016:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893477.442465:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893477.442481:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2ba2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fadae expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442560:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2ba9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442583:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442593:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442603:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2bb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442608:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442612:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442678:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf2bb7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442682:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf2bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442686:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf2bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893477.442707:0:22764:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787893477.442709:0:22764:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787893477.442747:0:22764:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf2bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442756:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442767:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2ba9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442772:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442787:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893477.442793:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442800:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2ba9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442811:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c6ebd400) 00010000:00010000:3.0:1787893477.442814:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893477.442818:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2ba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442833:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540e00/0x9232577658cf2ba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442853:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442859:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442865:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442870:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9fe540a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893477.442879:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442885:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442894:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fc9e6fade00) 00010000:00010000:3.0:1787893477.442897:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893477.442900:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2bb0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442905:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540a00/0x9232577658cf2bb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787893477.442905:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787893477.442937:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe541000/0x9232577658cf2ba2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadae expref: 8 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442950:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7200/0x9232577658cf2bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadae expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.442956:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc9e6fad900) 00010000:00010000:3.0:1787893477.442958:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893477.442960:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7200, rc 0) 00000100:00100000:3.0:1787893477.443087:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:18705:x1874741481862016:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 637us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.443094:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:0.0:1787893477.448383:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893477.448436:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481862144 00000100:00100000:1.0:1787893477.448446:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481862144 00000100:00100000:1.0:1787893477.448524:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:1.0:1787893477.448536:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:18705:x1874741481862144:12345-192.168.202.35@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787893477.448621:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:18705:x1874741481862144:12345-192.168.202.35@tcp:900:lhsmtool_posix.0 Request processed in 87us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893477.448629:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787893477.452166:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893477.452271:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481862400 00000100:00100000:0.0:1787893477.452279:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481862400 00000100:00100000:0.0:1787893477.452329:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:0.0:1787893477.452336:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:18705:x1874741481862400:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893477.452353:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893477.452373:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2bbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fadb5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452433:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2bc5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452444:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452452:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452476:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2bcc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452480:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2bcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452485:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2bcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452587:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2bd3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452592:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452596:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893477.452603:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787893477.452723:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452728:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452733:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452736:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893477.452740:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452751:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452760:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc9e6fad900) 00010000:00010000:0.0:1787893477.452762:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893477.452765:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2bc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452769:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2bc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.452993:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2bcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.453001:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2bcc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.453007:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2bcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.453011:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893477.453014:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2bcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.453021:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2bcc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.453029:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fc8c7518700) 00010000:00010000:0.0:1787893477.453032:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893477.453035:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2bcc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.453053:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2bcc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.455441:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2bbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadb5 expref: 10 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.455462:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0600/0x9232577658cf2bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadb5 expref: 9 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.455468:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc8c7518800) 00010000:00010000:0.0:1787893477.455470:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893477.455473:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0600, rc 0) 00000100:00100000:0.0:1787893477.455578:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+9:18705:x1874741481862400:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 3242us (3419us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787893477.455585:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:2.0:1787893477.462597:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893477.463336:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481862528 00000100:00100000:1.0:1787893477.463348:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481862528 00000100:00100000:1.0:1787893477.463414:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:1.0:1787893477.463425:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+9:18705:x1874741481862528:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787893477.463557:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+9:18705:x1874741481862528:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 Request processed in 133us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893477.463565:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:3.0:1787893477.467702:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.468758:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481862656 00000100:00100000:2.0:1787893477.468773:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481862656 00000100:00100000:2.0:1787893477.468947:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:2.0:1787893477.468959:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:18705:x1874741481862656:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1787893477.471383:0:24576:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2383us 00000100:00100000:3.0:1787893477.471466:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893477.471527:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481862784 00000100:00100000:3.0:1787893477.471537:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481862784 00000100:00100000:3.0:1787893477.471611:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 161 00000100:00100000:3.0:1787893477.471622:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+11:18090:x1874741481862784:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893477.471640:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893477.471659:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f7800/0x9232577658cf2be1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fadbc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.471686:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f7800/0x9232577658cf2be1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadbc expref: 12 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.471698:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c84f7800/0x9232577658cf2be1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadbc expref: 12 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.471708:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7800, rc 0) 00000100:00100000:3.0:1787893477.471762:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+12:18090:x1874741481862784:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 142us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.471770:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 161 00000100:00080000:0.0:1787893477.476107:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787893477.485608:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893477.485712:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481862912 00000100:00100000:0.0:1787893477.485731:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481862912 00000100:00100000:0.0:1787893477.488033:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 162 00000100:00100000:0.0:1787893477.488054:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+12:18090:x1874741481862912:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893477.488221:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+12:18090:x1874741481862912:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 176us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893477.488230:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 162 00010000:00010000:0.0:1787893477.497349:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893477.507768:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893477.507832:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481863040 00000100:00100000:1.0:1787893477.507848:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481863040 00000100:00100000:1.0:1787893477.507901:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 163 00000100:00100000:1.0:1787893477.507911:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+12:18090:x1874741481863040:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893477.508231:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+12:18090:x1874741481863040:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 320us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893477.508246:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 163 00000100:00100000:0.0:1787893477.514082:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:18705:x1874741481862656:12345-192.168.202.35@tcp:59:lhsmtool_posix.0 Request processed in 45114us (46378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893477.514109:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 26 00000100:00100000:1.0:1787893477.525249:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893477.526407:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481863168 00000100:00100000:3.0:1787893477.526420:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481863168 00000100:00100000:3.0:1787893477.526485:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 164 00000100:00100000:3.0:1787893477.526515:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+12:18090:x1874741481863168:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893477.526533:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893477.526552:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc8c84f6600/0x9232577658cf2be8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fadc3 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.526584:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc8c84f6600/0x9232577658cf2be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadc3 expref: 13 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.526611:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc8c84f6600/0x9232577658cf2be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadc3 expref: 13 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.526621:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6600, rc 0) 00000100:00100000:3.0:1787893477.526686:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+13:18090:x1874741481863168:12345-192.168.202.35@tcp:101:ll_cfg_requeue.0 Request processed in 173us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.526693:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 164 00000100:00100000:1.0:1787893477.530201:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893477.530275:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481863296 00000100:00100000:3.0:1787893477.530346:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481863296 00000100:00100000:3.0:1787893477.530429:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 165 00000100:00100000:3.0:1787893477.530441:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c6e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+13:18090:x1874741481863296:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.530841:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c6e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+13:18090:x1874741481863296:12345-192.168.202.35@tcp:501:ll_cfg_requeue.0 Request processed in 400us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.530851:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 165 00000100:00100000:3.0:1787893477.533243:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.533326:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481863424 00000100:00100000:2.0:1787893477.533343:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481863424 00000100:00100000:2.0:1787893477.533412:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 166 00000100:00100000:2.0:1787893477.533423:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+13:18090:x1874741481863424:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893477.533858:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d609832-c190-4f05-b711-9e10bcf3662d+13:18090:x1874741481863424:12345-192.168.202.35@tcp:503:ll_cfg_requeue.0 Request processed in 434us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.533870:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 166 00000100:00100000:1.0:1787893477.554108:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.554212:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481863552 00000100:00100000:2.0:1787893477.554229:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481863552 00000100:00100000:2.0:1787893477.554315:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:2.0:1787893477.554329:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+9:18712:x1874741481863552:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893477.554351:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893477.554377:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2bef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fadca expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554437:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2bf6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554451:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554463:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554639:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2bfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554649:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554657:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554701:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554708:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2bf6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554715:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554721:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893477.554725:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554733:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2bf6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554744:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c6ebd400) 00010000:00010000:2.0:1787893477.554747:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893477.554752:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2bf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554758:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2bf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554779:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554785:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2bfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554791:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2bfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554796:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893477.554799:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2bfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554805:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2bfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.554814:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc8c6614f00) 00010000:00010000:2.0:1787893477.554816:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893477.555187:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2bfd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.555194:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2bfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.555232:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2bef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadca expref: 10 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.555242:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c6ebd400) 00010000:00010000:2.0:1787893477.555245:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893477.555255:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2bef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadca expref: 10 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.555265:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69c800, rc 0) 00000100:00100000:2.0:1787893477.555381:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+9:18712:x1874741481863552:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1056us (1290us total) trans 0 rc 301/301 00000100:00100000:2.0:1787893477.555389:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:1.0:1787893477.563375:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893477.565248:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481863680 00000100:00100000:3.0:1787893477.565268:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481863680 00000100:00100000:3.0:1787893477.565471:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:3.0:1787893477.565485:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dd6f19be-6c98-4c86-964a-533d4d057bbd+9:18712:x1874741481863680:12345-192.168.202.35@tcp:700:lfs.0 00000100:00100000:3.0:1787893477.565656:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dd6f19be-6c98-4c86-964a-533d4d057bbd+9:18712:x1874741481863680:12345-192.168.202.35@tcp:700:lfs.0 Request processed in 174us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893477.565685:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:1.0:1787893477.569618:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893477.569848:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481863936 00000100:00100000:3.0:1787893477.569862:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481863936 00000100:00100000:3.0:1787893477.569998:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:3.0:1787893477.570021:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+9:18712:x1874741481863936:12345-192.168.202.35@tcp:36:lfs.0 00010000:00010000:3.0:1787893477.570096:0:22765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893477.570130:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728a00/0x9232577658cf2b1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fad37 expref: 9 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.570154:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c6ebd400) 00010000:00010000:3.0:1787893477.570160:0:22765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893477.570236:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.570251:0:22765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fada7 expref: 5 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.570261:0:22765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.570481:0:22765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fada7 expref: 5 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893477.570552:0:22765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fada7 expref: 5 pid: 22765 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893477.570570:0:22765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffb6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493514752:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893477.570708:0:22765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893477.574254:0:22765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffb6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493514752:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893477.574308:0:22765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893477.574694:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.575625:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481864064 00000100:00100000:2.0:1787893477.575637:0:23919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481864064 00010000:00010000:2.0:1787893477.575795:0:23919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fada7 expref: 6 pid: 22765 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893477.575854:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:2.0:1787893477.575867:0:23919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd12447e-462e-44ae-80f0-d0642d80e472+6:2390:x1874741481864064:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893477.575885:0:23919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893477.575894:0:23919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fada7 expref: 6 pid: 22765 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.575909:0:23919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fada7 expref: 6 pid: 22765 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.575949:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9fe540000/0x9232577658cf2b5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fada7 expref: 6 pid: 22765 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.575991:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c6ebd400) 00010000:00010000:2.0:1787893477.575997:0:23919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.576126:0:23919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.576135:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.576168:0:23919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893477.576231:0:23919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd12447e-462e-44ae-80f0-d0642d80e472+5:2390:x1874741481864064:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 368us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893477.576239:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00010000:00010000:2.0:1787893477.576268:0:22765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.576276:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.576416:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.576428:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.576436:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787893477.576603:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787893477.580475:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580538:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580551:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893477.580573:0:22765:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa1a351d reply state 00000000ddfc7b89 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580585:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580594:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:2.0:1787893477.580597:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893477.580603:0:22765:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787893477.580610:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787893477.580619:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580626:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580633:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580650:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893477.580655:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580663:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580685:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc9c6ebd400) 00010000:00010000:2.0:1787893477.580687:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893477.580692:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580698:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7a00/0x9232577658cf2c04 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893477.580964:0:22765:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa1a351d reply state 00000000ddfc7b89 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580975:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.580982:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc8c6614f00) 00010000:00010000:2.0:1787893477.580984:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893477.580987:0:22765:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787893477.581231:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+10:18712:x1874741481863936:12345-192.168.202.35@tcp:36:lfs.0 Request processed in 11217us (11621us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787893477.581242:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00000040:00080000:0.0:1787893477.620462:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787893477.673467:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.673886:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481864192 00000100:00100000:2.0:1787893477.673901:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481864192 00000100:00100000:2.0:1787893477.673997:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:2.0:1787893477.674010:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+10:18721:x1874741481864192:12345-192.168.202.35@tcp:101:lctl.0 00010000:00010000:2.0:1787893477.674048:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893477.674082:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2c19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fadd1 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.674173:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf2c20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.674208:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf2c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.674540:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf2c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893477.674604:0:22763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787893477.674608:0:22763:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893477.674795:0:22763:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf2c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.674836:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2c19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadd1 expref: 12 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.674862:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69da00/0x9232577658cf2c20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadd1 expref: 11 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.674872:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614c00) 00010000:00010000:2.0:1787893477.674875:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893477.674880:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69da00, rc 0) 00000100:00100000:2.0:1787893477.674979:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+11:18721:x1874741481864192:12345-192.168.202.35@tcp:101:lctl.0 Request processed in 972us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893477.674988:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:3.0:1787893477.703619:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893477.703860:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481864320 00000100:00100000:0.0:1787893477.703875:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481864320 00000100:00100000:0.0:1787893477.704076:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:0.0:1787893477.704090:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd12447e-462e-44ae-80f0-d0642d80e472+5:18722:x1874741481864320:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893477.704119:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893477.704150:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2c27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fadd8 expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.704257:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2c2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.704274:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.704419:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893477.704479:0:24576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787893477.704483:0:24576:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893477.704576:0:24576:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.704609:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2c27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadd8 expref: 7 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.704634:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1200/0x9232577658cf2c2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadd8 expref: 6 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.704686:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614c00) 00010000:00010000:0.0:1787893477.704689:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893477.704694:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1200, rc 0) 00000100:00100000:0.0:1787893477.704778:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd12447e-462e-44ae-80f0-d0642d80e472+6:18722:x1874741481864320:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 691us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893477.704786:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:3.0:1787893477.708310:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.709170:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481864448 00000100:00100000:2.0:1787893477.711786:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481864448 00000100:00100000:2.0:1787893477.711930:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:2.0:1787893477.712193:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+6:18722:x1874741481864448:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893477.712358:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893477.712412:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2c35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faddf expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.712523:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2c3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.712541:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.712556:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.712570:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.712578:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.712584:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.713055:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2c4a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.713066:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2c4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.713074:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2c4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893477.713120:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787893477.713124:0:22765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893477.713147:0:22765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2c4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.713171:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.713179:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2c3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.713186:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2c3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.713192:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893477.713198:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2c3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.713206:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2c3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714399:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614c00) 00010000:00010000:2.0:1787893477.714403:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893477.714410:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2c3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714418:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2c3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714441:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714449:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714456:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714477:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893477.714481:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714488:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714511:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc8c6614f00) 00010000:00010000:2.0:1787893477.714513:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893477.714516:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714523:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714572:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2c35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faddf expref: 8 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714590:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2c4a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faddf expref: 7 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.714599:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:2.0:1787893477.714601:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893477.714604:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69c800, rc 0) 00000100:00100000:2.0:1787893477.716148:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+7:18722:x1874741481864448:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 3943us (7835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893477.716162:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:3.0:1787893477.719567:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.719661:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481864576 00000100:00100000:2.0:1787893477.719693:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481864576 00000100:00100000:2.0:1787893477.719786:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:2.0:1787893477.719798:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd12447e-462e-44ae-80f0-d0642d80e472+5:18722:x1874741481864576:12345-192.168.202.35@tcp:900:lfs.0 00000100:00080000:1.0:1787893477.720071:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787893477.720382:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd12447e-462e-44ae-80f0-d0642d80e472+5:18722:x1874741481864576:12345-192.168.202.35@tcp:900:lfs.0 Request processed in 582us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893477.720393:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:3.0:1787893477.724339:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893477.724537:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481864832 00000100:00100000:0.0:1787893477.724552:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481864832 00000100:00100000:0.0:1787893477.724630:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:0.0:1787893477.724643:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e711dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd12447e-462e-44ae-80f0-d0642d80e472+7:18722:x1874741481864832:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893477.724672:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893477.724702:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2c51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fade6 expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893477.724855:0:24576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787893477.725008:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2c51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fade6 expref: 9 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.725026:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614c00) 00010000:00010000:0.0:1787893477.725029:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893477.725035:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2c51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fade6 expref: 9 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.725052:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0200, rc 0) 00000100:00100000:0.0:1787893477.725121:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e711dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd12447e-462e-44ae-80f0-d0642d80e472+8:18722:x1874741481864832:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 481us (798us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1787893477.725146:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:0.0:1787893477.728771:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893477.728948:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481865088 00000100:00100000:1.0:1787893477.728962:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481865088 00000100:00100000:1.0:1787893477.729095:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:1.0:1787893477.729110:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd12447e-462e-44ae-80f0-d0642d80e472+8:18722:x1874741481865088:12345-192.168.202.35@tcp:36:lfs.0 00010000:00010000:1.0:1787893477.729189:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893477.729237:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2c4a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faddf expref: 8 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893477.729264:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:1.0:1787893477.729269:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893477.729307:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893477.729322:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893477.729333:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893477.729632:0:22763:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a947b41d reply state 00000000a8dc3fee transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893477.729681:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893477.729688:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:1.0:1787893477.729691:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787893477.729694:0:22763:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787893477.729703:0:22763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787893477.729813:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd12447e-462e-44ae-80f0-d0642d80e472+9:18722:x1874741481865088:12345-192.168.202.35@tcp:36:lfs.0 Request processed in 706us (1058us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1787893477.729832:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 33 00000100:00100000:1.0:1787893477.735290:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893477.736428:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481865344 00000100:00100000:0.0:1787893477.736445:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481865344 00000100:00100000:0.0:1787893477.736604:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:0.0:1787893477.736616:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd12447e-462e-44ae-80f0-d0642d80e472+9:18722:x1874741481865344:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787893477.737096:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd12447e-462e-44ae-80f0-d0642d80e472+10:18722:x1874741481865344:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 480us (1817us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787893477.737106:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:3.0:1787893477.743635:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893477.743950:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481865600 00000100:00100000:0.0:1787893477.743963:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481865600 00000100:00100000:0.0:1787893477.744039:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:0.0:1787893477.744052:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd12447e-462e-44ae-80f0-d0642d80e472+10:18722:x1874741481865600:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893477.744088:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893477.744117:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2c66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faded expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744225:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744243:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744256:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744267:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744402:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744409:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893477.744597:0:24576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787893477.744708:0:24576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744717:0:24576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744724:0:24576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744731:0:24576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893477.744736:0:24576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744744:0:24576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744759:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614c00) 00010000:00010000:0.0:1787893477.744763:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893477.744769:0:24576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744775:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744804:0:24576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744809:0:24576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744814:0:24576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744830:0:24576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893477.744833:0:24576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744840:0:24576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744849:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc8c6614f00) 00010000:00010000:0.0:1787893477.744851:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893477.744854:0:24576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744859:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744899:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2c66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faded expref: 12 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744909:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614c00) 00010000:00010000:0.0:1787893477.744912:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893477.744922:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2c66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faded expref: 12 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.744932:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0200, rc 0) 00000100:00100000:0.0:1787893477.745003:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd12447e-462e-44ae-80f0-d0642d80e472+11:18722:x1874741481865600:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 954us (1385us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1787893477.745012:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 34 00000100:00100000:0.0:1787893477.750107:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.750426:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481865728 00000100:00100000:2.0:1787893477.750441:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481865728 00000100:00100000:2.0:1787893477.750564:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:2.0:1787893477.750578:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+11:18722:x1874741481865728:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893477.750611:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893477.750756:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2c82 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fadf4 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.750903:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.750921:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.750935:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893477.750963:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787893477.750966:0:22765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893477.750989:0:22765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.751020:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2c82 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadf4 expref: 13 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.751064:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadf4 expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.751075:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:2.0:1787893477.751078:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893477.751082:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69ce00, rc 0) 00000100:00100000:2.0:1787893477.751164:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+12:18722:x1874741481865728:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 589us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893477.751173:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 35 00000100:00100000:1.0:1787893477.756482:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.757016:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481865856 00000100:00100000:2.0:1787893477.757030:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481865856 00000100:00100000:2.0:1787893477.757106:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:2.0:1787893477.757119:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd12447e-462e-44ae-80f0-d0642d80e472+12:18722:x1874741481865856:12345-192.168.202.35@tcp:37:lfs.0 00000100:00100000:2.0:1787893477.765433:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd12447e-462e-44ae-80f0-d0642d80e472+12:18722:x1874741481865856:12345-192.168.202.35@tcp:37:lfs.0 Request processed in 8298us (8950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893477.765451:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:1.0:1787893477.769052:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.769410:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481866112 00000100:00100000:2.0:1787893477.769424:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481866112 00000100:00100000:2.0:1787893477.769527:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:2.0:1787893477.769541:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7c53450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd12447e-462e-44ae-80f0-d0642d80e472+12:18722:x1874741481866112:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787893477.769887:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7c53450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd12447e-462e-44ae-80f0-d0642d80e472+13:18722:x1874741481866112:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 348us (848us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787893477.769896:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 4 00000100:00100000:1.0:1787893477.842937:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893477.843058:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481866240 00000100:00100000:0.0:1787893477.843072:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481866240 00000100:00100000:0.0:1787893477.843155:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:0.0:1787893477.843170:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+11:18728:x1874741481866240:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787893477.843199:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893477.843228:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2c90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fadfb expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843323:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843341:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843354:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843368:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843375:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843404:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843564:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1400/0x9232577658cf2ca5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843574:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1400/0x9232577658cf2ca5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843581:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1400/0x9232577658cf2ca5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893477.843628:0:24576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787893477.843633:0:24576:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893477.843703:0:24576:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1400/0x9232577658cf2ca5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843718:0:24576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843725:0:24576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843732:0:24576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843740:0:24576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893477.843745:0:24576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843753:0:24576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843776:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614c00) 00010000:00010000:0.0:1787893477.843779:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893477.843784:0:24576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843791:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2c97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843807:0:24576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843814:0:24576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843830:0:24576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843835:0:24576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893477.843838:0:24576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843844:0:24576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843851:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc8c6614f00) 00010000:00010000:0.0:1787893477.843853:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893477.843857:0:24576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843863:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2c9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843913:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2c90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadfb expref: 13 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843929:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1400/0x9232577658cf2ca5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadfb expref: 12 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.843936:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:0.0:1787893477.843939:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787893477.843942:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1400, rc 0) 00000100:00100000:0.0:1787893477.844018:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+12:18728:x1874741481866240:12345-192.168.202.35@tcp:101:bash.0 Request processed in 852us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893477.844026:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 36 00000100:00100000:1.0:1787893477.848789:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.848892:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481866368 00000100:00100000:2.0:1787893477.848923:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481866368 00000100:00100000:2.0:1787893477.849012:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:2.0:1787893477.849025:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:18728:x1874741481866368:12345-192.168.202.35@tcp:900:bash.0 00000100:00100000:2.0:1787893477.849141:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:18728:x1874741481866368:12345-192.168.202.35@tcp:900:bash.0 Request processed in 118us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893477.849150:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:1.0:1787893477.854017:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.854416:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481866624 00000100:00100000:2.0:1787893477.854430:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481866624 00000100:00100000:2.0:1787893477.854551:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 37 00000100:00100000:2.0:1787893477.854563:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+12:18728:x1874741481866624:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893477.854594:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893477.854621:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2cac lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae02 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.854777:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.854795:0:22765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadf4 expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.854804:0:22765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.854862:0:22765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadf4 expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.854879:0:22765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadf4 expref: 12 pid: 22765 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893477.854918:0:22765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493514880:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893477.855039:0:22765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5e5bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893477.857862:0:22765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493514880:192.168.202.35@tcp:104: 00010000:00010000:2.0:1787893477.857903:0:22765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893477.859853:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893477.860087:0:25793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481866752 00000100:00100000:0.0:1787893477.860101:0:25793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481866752 00010000:00010000:0.0:1787893477.860160:0:25793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadf4 expref: 13 pid: 22765 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893477.860207:0:25793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 16 00000100:00100000:0.0:1787893477.860231:0:25793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd12447e-462e-44ae-80f0-d0642d80e472+13:2390:x1874741481866752:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893477.860250:0:25793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893477.860259:0:25793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadf4 expref: 13 pid: 22765 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.860286:0:25793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadf4 expref: 13 pid: 22765 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.860339:0:25793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2c89 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fadf4 expref: 13 pid: 22765 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.860364:0:25793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:0.0:1787893477.860370:0:25793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.860382:0:25793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.860390:0:25793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.860430:0:25793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893477.860573:0:25793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd12447e-462e-44ae-80f0-d0642d80e472+12:2390:x1874741481866752:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 343us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893477.860581:0:25793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 16 00010000:00010000:2.0:1787893477.861194:0:22765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.861217:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.863534:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.863561:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.863575:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868644:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6c00/0x9232577658cf2cc1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868666:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6c00/0x9232577658cf2cc1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868686:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6c00/0x9232577658cf2cc1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893477.868785:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787893477.868828:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868837:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868844:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868850:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893477.868854:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868862:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868875:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:2.0:1787893477.868878:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893477.868882:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868887:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2cb3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893477.868903:0:22765:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077f1f6ab reply state 00000000f23c28d0 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868913:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868929:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fc8c6614900) 00010000:00010000:2.0:1787893477.868932:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893477.868935:0:22765:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787893477.868976:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2cac lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae02 expref: 15 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868992:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6c00/0x9232577658cf2cc1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae02 expref: 14 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893477.868999:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893477.869001:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787893477.869004:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9d0ad6c00, rc 0) 00000100:00100000:2.0:1787893477.872296:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+15:18728:x1874741481866624:12345-192.168.202.35@tcp:101:bash.0 Request processed in 17724us (18283us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1787893477.874483:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 37 00000040:00080000:0.0:1787893477.877619:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787893477.903227:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893477.903366:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481866880 00000100:00100000:0.0:1787893477.903380:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481866880 00000100:00100000:0.0:1787893477.903455:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:0.0:1787893477.903467:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+15:18728:x1874741481866880:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787893477.903527:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893477.903557:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2ccf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae09 expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.903654:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2cd6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.903689:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2cd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.903703:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2cd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893477.903784:0:24576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787893477.903790:0:24576:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787893477.903812:0:24576:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2cd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.903835:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2cd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.903866:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2ccf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae09 expref: 17 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.903890:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2cd6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae09 expref: 16 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893477.903901:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893477.903904:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893477.903908:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1a00, rc 0) 00000100:00100000:0.0:1787893477.903988:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+16:18728:x1874741481866880:12345-192.168.202.35@tcp:101:bash.0 Request processed in 524us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893477.903997:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 38 00000100:00100000:1.0:1787893477.912680:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893477.913050:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481867136 00000100:00100000:2.0:1787893477.913063:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481867136 00000100:00100000:2.0:1787893477.913136:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:2.0:1787893477.913149:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+16:18728:x1874741481867136:12345-192.168.202.35@tcp:35:bash.0 00000100:00100000:2.0:1787893477.913591:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+17:18728:x1874741481867136:12345-192.168.202.35@tcp:35:bash.0 Request processed in 444us (925us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1787893477.913600:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 5 00000100:00100000:1.0:1787893478.046163:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893478.046279:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481867392 00000100:00100000:2.0:1787893478.046294:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481867392 00000100:00100000:2.0:1787893478.046420:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:2.0:1787893478.046430:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+17:18738:x1874741481867392:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:2.0:1787893478.046479:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893478.046548:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6000/0x9232577658cf2cdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae10 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893478.046675:0:22763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787893478.046812:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6000/0x9232577658cf2cdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae10 expref: 19 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.046843:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614c00) 00010000:00010000:2.0:1787893478.046846:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893478.046852:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6000/0x9232577658cf2cdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae10 expref: 19 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.046869:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9d0ad6000, rc 0) 00000100:00100000:2.0:1787893478.046954:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+18:18738:x1874741481867392:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 524us (805us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1787893478.046970:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 39 00000100:00100000:1.0:1787893478.058802:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893478.064300:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481867648 00000100:00100000:2.0:1787893478.064563:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481867648 00000100:00100000:2.0:1787893478.064656:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:2.0:1787893478.064670:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9fa52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+18:18738:x1874741481867648:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:2.0:1787893478.065258:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9fa52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+19:18738:x1874741481867648:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 588us (6471us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1787893478.065269:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 6 00000100:00100000:1.0:1787893478.135731:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893478.135874:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481867904 00000100:00100000:0.0:1787893478.135889:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481867904 00000100:00100000:0.0:1787893478.135971:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:0.0:1787893478.136013:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+19:18741:x1874741481867904:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893478.136049:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893478.136078:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2ceb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae17 expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.136224:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2cf2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.136241:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2cf2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.136255:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2cf2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893478.136269:0:24576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787893478.136437:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2ceb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae17 expref: 22 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.136461:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2cf2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae17 expref: 21 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.136471:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893478.136475:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893478.136479:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1000, rc 0) 00000100:00100000:0.0:1787893478.136629:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+21:18741:x1874741481867904:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 630us (912us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1787893478.136637:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 40 00000100:00100000:1.0:1787893478.147788:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893478.147857:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893478.147983:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481868160 00000100:00100000:2.0:1787893478.147998:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481868160 00000100:00100000:2.0:1787893478.148097:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:2.0:1787893478.148127:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+21:2391:x1874741481868160:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893478.148150:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893478.148182:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2cf2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae17 expref: 21 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.148206:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893478.148213:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893478.148296:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+20:2391:x1874741481868160:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 172us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893478.148304:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:0.0:1787893478.149677:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481868032 00000100:00100000:0.0:1787893478.149694:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481868032 00000100:00100000:0.0:1787893478.149786:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:0.0:1787893478.149799:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+20:18741:x1874741481868032:12345-192.168.202.35@tcp:54:lfs.0 00010000:00010000:0.0:1787893478.149904:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d00 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.149925:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.149950:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.150141:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.150150:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d00 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.150158:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d00 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.150164:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893478.150169:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d00 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.150177:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d00 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.150191:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893478.150194:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893478.150199:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d00 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.150218:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d00 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893478.150677:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+20:18741:x1874741481868032:12345-192.168.202.35@tcp:54:lfs.0 Request processed in 875us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893478.150688:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 41 00000100:00100000:1.0:1787893478.155834:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893478.157338:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481868416 00000100:00100000:0.0:1787893478.157360:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481868416 00000100:00100000:0.0:1787893478.157466:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:0.0:1787893478.157482:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+20:18741:x1874741481868416:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787893478.157826:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+21:18741:x1874741481868416:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 338us (2008us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1787893478.157835:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 7 00000100:00100000:1.0:1787893478.427786:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893478.427852:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893478.427879:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481868544 00000100:00100000:0.0:1787893478.427893:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481868544 00000100:00100000:1.0:1787893478.427915:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893478.427956:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893478.427973:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 167 00000100:00100000:1.0:1787893478.427974:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893478.427985:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+13:2392:x1874741481868544:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893478.427990:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893478.428005:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893478.428037:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893478.428062:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481869056 00000100:00100000:1.0:1787893478.428066:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481869056 00000100:00100000:0.0:1787893478.428096:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d609832-c190-4f05-b711-9e10bcf3662d+13:2392:x1874741481868544:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 113us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893478.428105:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 167 00000100:00100000:0.0:1787893478.428162:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481868672 00000100:00100000:0.0:1787893478.428166:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481868672 00000100:00100000:0.0:1787893478.428180:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481869184 00000100:00100000:0.0:1787893478.428183:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481869184 00000100:00100000:0.0:1787893478.428196:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:0.0:1787893478.428203:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+12:2392:x1874741481869056:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893478.428256:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+12:2392:x1874741481869056:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 51us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893478.428264:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:0.0:1787893478.428287:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:0.0:1787893478.428293:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481868672:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893478.428320:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481868672:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893478.428326:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:0.0:1787893478.428339:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:0.0:1787893478.428345:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+5:2392:x1874741481869184:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893478.428367:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd12447e-462e-44ae-80f0-d0642d80e472+5:2392:x1874741481869184:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 22us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893478.428373:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:2.0:1787893478.430120:0:25379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481868800 00000100:00100000:2.0:1787893478.430138:0:25379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481868800 00000100:00100000:1.0:1787893478.430158:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481869312 00000100:00100000:1.0:1787893478.430163:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481869312 00000100:00100000:2.0:1787893478.430215:0:25379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481869440 00000100:00100000:1.0:1787893478.430215:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481868928 00000100:00100000:2.0:1787893478.430219:0:25379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481869440 00000100:00100000:1.0:1787893478.430219:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481868928 00000100:00100000:1.0:1787893478.430240:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:1.0:1787893478.430250:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481868800:12345-192.168.202.35@tcp:400:kworker.0 00000100:00080000:0.0:1787893478.430292:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787893478.430297:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893478.430341:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481868800:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 92us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893478.431285:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:2.0:1787893478.431308:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd12447e-462e-44ae-80f0-d0642d80e472+5:2392:x1874741481869312:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893478.431370:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd12447e-462e-44ae-80f0-d0642d80e472+5:2392:x1874741481869312:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 74us (3413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893478.431379:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:2.0:1787893478.431410:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:2.0:1787893478.431417:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481868928:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893478.431447:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2392:x1874741481868928:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 31us (3456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893478.431454:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:2.0:1787893478.431467:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:2.0:1787893478.431474:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd12447e-462e-44ae-80f0-d0642d80e472+5:2392:x1874741481869440:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893478.431542:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd12447e-462e-44ae-80f0-d0642d80e472+5:2392:x1874741481869440:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 67us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893478.431549:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:1.0:1787893478.431906:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00010000:00010000:0.0:1787893478.514352:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893478.563342:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893478.563533:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481869696 00000100:00100000:0.0:1787893478.563550:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481869696 00000100:00100000:0.0:1787893478.563841:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:0.0:1787893478.563856:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+21:18772:x1874741481869696:12345-192.168.202.35@tcp:101:cat.0 00010000:00010000:0.0:1787893478.563895:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893478.563987:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d07 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae1e expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.564227:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2d0e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.564266:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2d0e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.564282:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2d0e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893478.564298:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787893478.564524:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d07 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae1e expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.564553:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2d0e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae1e expref: 23 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.564563:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893478.564566:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893478.564570:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1600, rc 0) 00000100:00100000:0.0:1787893478.565070:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+23:18772:x1874741481869696:12345-192.168.202.35@tcp:101:cat.0 Request processed in 1216us (1740us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1787893478.565080:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 42 00000100:00100000:1.0:1787893478.572115:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893478.573260:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893478.573398:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481870080 00000100:00100000:2.0:1787893478.573413:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481870080 00000100:00100000:0.0:1787893478.573531:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481869952 00000100:00100000:0.0:1787893478.573537:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481869952 00000100:00100000:3.0:1787893478.574188:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:3.0:1787893478.574206:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c67ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+24:18772:x1874741481869952:12345-192.168.202.35@tcp:35:cat.0 00000100:00100000:3.0:1787893478.574722:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c67ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+25:18772:x1874741481869952:12345-192.168.202.35@tcp:35:cat.0 Request processed in 519us (2690us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1787893478.574732:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 8 00000100:00100000:2.0:1787893478.574844:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:2.0:1787893478.574864:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+24:2392:x1874741481870080:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893478.574878:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893478.574911:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2d0e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae1e expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.574934:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893478.574940:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893478.574962:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+23:2392:x1874741481870080:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 102us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893478.574969:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 1 00000100:00100000:1.0:1787893478.717833:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893478.718294:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481870336 00000100:00100000:2.0:1787893478.718308:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481870336 00000100:00100000:2.0:1787893478.718398:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:2.0:1787893478.718413:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+23:18778:x1874741481870336:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:2.0:1787893478.718468:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893478.718554:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d1c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae25 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.718706:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7a00/0x9232577658cf2d23 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.718745:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7a00/0x9232577658cf2d23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.718758:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7a00/0x9232577658cf2d23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893478.718771:0:22763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787893478.718949:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d1c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae25 expref: 26 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.718973:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7a00/0x9232577658cf2d23 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae25 expref: 25 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.718983:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893478.718987:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893478.718991:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9d0ad7a00, rc 0) 00000100:00100000:2.0:1787893478.719067:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+25:18778:x1874741481870336:12345-192.168.202.35@tcp:101:dd.0 Request processed in 657us (1259us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1787893478.719076:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 43 00000100:00100000:1.0:1787893478.726168:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893478.726331:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481870464 00000100:00100000:2.0:1787893478.726347:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481870464 00000100:00100000:2.0:1787893478.726428:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:2.0:1787893478.726453:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+25:18778:x1874741481870464:12345-192.168.202.35@tcp:101:dd.0 00010000:00010000:2.0:1787893478.726486:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893478.726544:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d31 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae2c expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.726620:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7e00/0x9232577658cf2d38 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.726638:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7e00/0x9232577658cf2d38 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.726651:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7e00/0x9232577658cf2d38 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.726804:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d31 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae2c expref: 27 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.726836:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7e00/0x9232577658cf2d38 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae2c expref: 26 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.726847:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893478.726850:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787893478.726854:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9d0ad7e00, rc 0) 00000100:00100000:2.0:1787893478.726939:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+26:18778:x1874741481870464:12345-192.168.202.35@tcp:101:dd.0 Request processed in 489us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893478.726947:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 44 00000100:00100000:1.0:1787893478.727149:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893478.727236:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481870592 00000100:00100000:0.0:1787893478.727243:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481870592 00000100:00100000:0.0:1787893478.727290:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:0.0:1787893478.727298:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+26:2392:x1874741481870592:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893478.727310:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893478.727327:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7a00/0x9232577658cf2d23 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae25 expref: 26 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893478.727347:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893478.727351:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893478.727391:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+25:2392:x1874741481870592:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893478.727399:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 2 00000100:00100000:3.0:1787893478.731935:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893478.732031:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481870848 00000100:00100000:2.0:1787893478.732043:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481870848 00000100:00100000:2.0:1787893478.732106:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 45 00000100:00100000:2.0:1787893478.732116:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c3e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+25:18778:x1874741481870848:12345-192.168.202.35@tcp:36:dd.0 00010000:00010000:2.0:1787893478.732183:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893478.732214:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2cd6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae09 expref: 25 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.732258:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893478.732263:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893478.732528:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.732546:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.732558:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893478.732611:0:22763:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1787893478.732630:0:22763:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f03124a3 reply state 000000006d8b41c3 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.732641:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893478.732647:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893478.732651:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893478.732654:0:22763:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893478.732770:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c3e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+27:18778:x1874741481870848:12345-192.168.202.35@tcp:36:dd.0 Request processed in 653us (851us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1787893478.732779:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 45 00000020:00080000:2.0:1787893478.732785:0:22763:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787893478.860221:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893478.860844:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481871104 00000100:00100000:3.0:1787893478.860860:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481871104 00000100:00100000:3.0:1787893478.861014:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:3.0:1787893478.861028:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+27:18778:x1874741481871104:12345-192.168.202.35@tcp:35:dd.0 00000100:00100000:3.0:1787893478.861333:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+28:18778:x1874741481871104:12345-192.168.202.35@tcp:35:dd.0 Request processed in 308us (1131us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1787893478.861339:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 9 00000100:00100000:1.0:1787893479.090133:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493515008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787893479.090235:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893479.091072:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493515008 00000100:00100000:3.0:1787893479.091086:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493515008 00000100:00100000:3.0:1787893479.091177:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787893479.091189:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493515008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787893479.091246:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787893479.091338:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493515008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893479.091597:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787893479.091731:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493515008:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787893479.092050:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893479.135866:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893479.138158:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481871232 00000100:00100000:2.0:1787893479.138179:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481871232 00000100:00100000:2.0:1787893479.138381:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00100000:2.0:1787893479.138417:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+28:18793:x1874741481871232:12345-192.168.202.35@tcp:101:stat.0 00010000:00010000:2.0:1787893479.138466:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893479.138512:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d46 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae33 expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138604:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d4d lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138623:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d4d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138636:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d4d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138658:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d54 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138666:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138672:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138771:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7800/0x9232577658cf2d5b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138780:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7800/0x9232577658cf2d5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138787:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7800/0x9232577658cf2d5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893479.138863:0:24576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787893479.138868:0:24576:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893479.138919:0:24576:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7800/0x9232577658cf2d5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138936:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7800/0x9232577658cf2d5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138945:0:24576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d4d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138951:0:24576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d4d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138958:0:24576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d4d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138964:0:24576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9d0ad7c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893479.138970:0:24576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d4d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138978:0:24576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d4d lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.138993:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:2.0:1787893479.138996:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893479.139001:0:24576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d4d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.139008:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d4d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.139036:0:24576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.139041:0:24576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d54 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.139047:0:24576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d54 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.139051:0:24576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9d0ad6e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893479.139054:0:24576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d54 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.139059:0:24576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d54 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.139067:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fc8c6614900) 00010000:00010000:2.0:1787893479.139069:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893479.139072:0:24576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d54 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.139076:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d54 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.139110:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d46 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae33 expref: 30 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.139125:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7800/0x9232577658cf2d5b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae33 expref: 29 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.139144:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893479.139146:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893479.139149:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9d0ad7800, rc 0) 00000100:00100000:2.0:1787893479.139247:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+29:18793:x1874741481871232:12345-192.168.202.35@tcp:101:stat.0 Request processed in 836us (3398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893479.139255:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 46 00000100:00080000:0.0:1787893479.141948:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893479.234918:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893479.236546:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481871488 00000100:00100000:2.0:1787893479.236567:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481871488 00000100:00100000:2.0:1787893479.236708:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 47 00000100:00100000:2.0:1787893479.236722:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+29:18799:x1874741481871488:12345-192.168.202.35@tcp:36:truncate.0 00010000:00010000:2.0:1787893479.236804:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893479.236865:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7800/0x9232577658cf2d5b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae33 expref: 29 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.236889:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893479.236895:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893479.237329:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.237465:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.237480:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893479.237590:0:22763:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:2.0:1787893479.237618:0:22763:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b8d89e0 reply state 00000000951835e5 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.237823:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.237831:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893479.237834:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787893479.237838:0:22763:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893479.238214:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+31:18799:x1874741481871488:12345-192.168.202.35@tcp:36:truncate.0 Request processed in 1492us (3311us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1787893479.238225:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 47 00000020:00080000:2.0:1787893479.238232:0:22763:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787893479.522375:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893479.522946:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481871616 00000100:00100000:2.0:1787893479.522961:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481871616 00000100:00100000:2.0:1787893479.523099:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 48 00000100:00100000:2.0:1787893479.523113:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+31:18813:x1874741481871616:12345-192.168.202.35@tcp:101:stat.0 00010000:00010000:2.0:1787893479.523146:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893479.523173:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7800/0x9232577658cf2d69 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae3a expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.523290:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d70 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.523308:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d70 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.523322:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d70 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.523633:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d77 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.523748:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d77 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.523759:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d77 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.524045:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.524057:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.524065:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893479.524128:0:24576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1787893479.524133:0:24576:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893479.524159:0:24576:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.524174:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.524184:0:24576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d70 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.524191:0:24576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d70 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.524199:0:24576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d70 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.524218:0:24576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9d0ad6e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893479.524224:0:24576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d70 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.524233:0:24576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d70 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.524250:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:2.0:1787893479.524254:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893479.525160:0:24576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d70 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.525177:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2d70 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.525200:0:24576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d77 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.525207:0:24576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d77 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.525213:0:24576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d77 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.525218:0:24576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9d0ad7c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893479.525222:0:24576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d77 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.525230:0:24576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d77 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.525274:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fc8c6614900) 00010000:00010000:2.0:1787893479.525278:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893479.525281:0:24576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d77 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.525288:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2d77 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.525342:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7800/0x9232577658cf2d69 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae3a expref: 33 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.526700:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae3a expref: 32 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.526713:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893479.526716:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893479.526720:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9d0ad6800, rc 0) 00000100:00100000:2.0:1787893479.526906:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+32:18813:x1874741481871616:12345-192.168.202.35@tcp:101:stat.0 Request processed in 3727us (4490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893479.526920:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 48 00010000:00010000:3.0:1787893479.540289:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893479.602725:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493515136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787893479.602853:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893479.603092:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493515136 00000100:00100000:1.0:1787893479.603103:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493515136 00000100:00100000:1.0:1787893479.603176:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787893479.603187:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493515136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787893479.603236:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787893479.603325:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493515136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893479.603335:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787893479.603550:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493515136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787893479.627457:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493515264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787893479.627591:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893479.631252:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493515264 00000100:00100000:0.0:1787893479.631284:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493515264 00000100:00100000:0.0:1787893479.631388:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787893479.631402:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493515264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787893479.631463:0:23786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787893479.631630:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493515264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 229us (4038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893479.631638:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787893479.632187:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493515264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787893479.667170:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893479.667437:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481871872 00000100:00100000:0.0:1787893479.667451:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481871872 00000100:00100000:0.0:1787893479.667813:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:0.0:1787893479.667827:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+32:18823:x1874741481871872:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893479.667858:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893479.667886:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae41 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893479.668027:0:22764:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787893479.668169:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae41 expref: 34 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.668211:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614c00) 00010000:00010000:0.0:1787893479.668215:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893479.668221:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2d85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae41 expref: 34 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.668248:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0200, rc 0) 00000100:00100000:0.0:1787893479.668349:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+33:18823:x1874741481871872:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 524us (1195us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1787893479.668356:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 49 00000100:00100000:1.0:1787893479.673242:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893479.673352:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481872128 00000100:00100000:0.0:1787893479.673366:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481872128 00000100:00100000:0.0:1787893479.673447:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:0.0:1787893479.673460:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e7105050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+33:18823:x1874741481872128:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:0.0:1787893479.673830:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e7105050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+34:18823:x1874741481872128:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 371us (602us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1787893479.673838:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 10 00000100:00100000:1.0:1787893479.763135:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893479.763405:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481872384 00000100:00100000:3.0:1787893479.763418:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481872384 00000100:00100000:3.0:1787893479.763552:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:3.0:1787893479.763563:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+34:18829:x1874741481872384:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893479.763601:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893479.763630:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf2d93 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae48 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.763780:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.763798:0:22765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6c00/0x9232577658cf2cc1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae02 expref: 35 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.763817:0:22765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae3a expref: 35 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.763827:0:22765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.763891:0:22765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae3a expref: 35 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.763907:0:22765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae3a expref: 35 pid: 24576 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893479.763925:0:22765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7524000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493515392:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893479.764052:0:22765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6c00/0x9232577658cf2cc1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae02 expref: 35 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.764061:0:22765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6c00/0x9232577658cf2cc1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae02 expref: 35 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893479.764071:0:22765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493515520:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893479.764096:0:22765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc8c5c9ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893479.767769:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893479.767929:0:22765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7524000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493515392:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893479.767947:0:22765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c7525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493515520:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893479.767971:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481872512 00000100:00100000:2.0:1787893479.767980:0:23919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481872512 00010000:00010000:3.0:1787893479.767983:0:22765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.768041:0:23919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae3a expref: 36 pid: 24576 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893479.768117:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:2.0:1787893479.768129:0:23919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c759c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+36:2391:x1874741481872512:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893479.768151:0:23919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893479.768160:0:23919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae3a expref: 36 pid: 24576 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.768174:0:23919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae3a expref: 36 pid: 24576 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.768204:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6800/0x9232577658cf2d7e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae3a expref: 36 pid: 24576 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.768225:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893479.768230:0:23919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.768251:0:23919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.768259:0:23919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893479.768329:0:23919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c759c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+35:2391:x1874741481872512:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 202us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893479.768346:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 17 00000100:00100000:1.0:1787893479.771221:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893479.771420:0:25793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481872640 00000100:00100000:3.0:1787893479.771432:0:25793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481872640 00010000:00010000:3.0:1787893479.771478:0:25793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6c00/0x9232577658cf2cc1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae02 expref: 35 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893479.771594:0:25793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 18 00000100:00100000:3.0:1787893479.771626:0:25793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd6f19be-6c98-4c86-964a-533d4d057bbd+35:2390:x1874741481872640:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893479.771658:0:25793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893479.771667:0:25793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6c00/0x9232577658cf2cc1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae02 expref: 35 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.771683:0:25793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6c00/0x9232577658cf2cc1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae02 expref: 35 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.771711:0:25793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6c00/0x9232577658cf2cc1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae02 expref: 35 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.771728:0:25793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:3.0:1787893479.771733:0:25793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.771743:0:25793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.771750:0:25793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893479.771783:0:25793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893479.771858:0:25793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd6f19be-6c98-4c86-964a-533d4d057bbd+34:2390:x1874741481872640:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 234us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893479.771866:0:25793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 18 00010000:00010000:1.0:1787893479.771938:0:22765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893479.771948:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893479.771970:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1787893479.772145:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6e00/0x9232577658cf2d93 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae48 expref: 35 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893479.772159:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae48 expref: 34 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893479.772165:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:1.0:1787893479.772167:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787893479.772175:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6c00, rc 0) 00000100:00100000:1.0:1787893479.772199:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+34:18829:x1874741481872384:12345-192.168.202.35@tcp:101:bash.0 Request processed in 8639us (9081us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1787893479.772205:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 50 00000100:00100000:1.0:1787893479.775749:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893479.775815:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481872896 00000100:00100000:0.0:1787893479.775826:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481872896 00000100:00100000:0.0:1787893479.776032:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 51 00000100:00100000:0.0:1787893479.776042:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+34:18829:x1874741481872896:12345-192.168.202.35@tcp:36:bash.0 00010000:00010000:0.0:1787893479.776438:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.776457:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.776487:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893479.776600:0:22764:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:0.0:1787893479.776627:0:22764:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a87d7c9 reply state 00000000e7d404a6 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.776653:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.776663:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893479.776667:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787893479.776671:0:22764:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787893479.776814:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+37:18829:x1874741481872896:12345-192.168.202.35@tcp:36:bash.0 Request processed in 758us (1064us total) trans 12884901914 rc 0/0 00000100:00100000:0.0:1787893479.776822:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 51 00000020:00080000:0.0:1787893479.776828:0:22764:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787893479.779214:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893479.779326:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481873024 00000100:00100000:0.0:1787893479.779348:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481873024 00000100:00100000:0.0:1787893479.779426:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:0.0:1787893479.779439:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+37:18829:x1874741481873024:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787893479.779473:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893479.779536:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2daf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae4f expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.779626:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2daf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae4f expref: 38 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.779645:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2daf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae4f expref: 38 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.779688:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893479.779691:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893479.779695:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1a00, rc 0) 00000100:00100000:0.0:1787893479.779753:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+38:18829:x1874741481873024:12345-192.168.202.35@tcp:101:bash.0 Request processed in 318us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893479.779759:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 52 00000100:00100000:1.0:1787893479.785429:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893479.785605:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481873152 00000100:00100000:2.0:1787893479.785619:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481873152 00000100:00100000:2.0:1787893479.785821:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:2.0:1787893479.785831:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+38:18829:x1874741481873152:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:2.0:1787893479.785867:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893479.785897:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2db6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae56 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.786016:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2dbd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.786037:0:22763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae48 expref: 39 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.786044:0:22763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2dbd lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.786095:0:22763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae48 expref: 39 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.786105:0:22763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae48 expref: 39 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893479.786118:0:22763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22763:1874741493515648:192.168.202.35@tcp:104: 00000100:00100000:2.0:1787893479.786214:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9e5e5b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787893479.789220:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893479.789348:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481873280 00000100:00100000:1.0:1787893479.789361:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481873280 00010000:00010000:1.0:1787893479.789417:0:22749:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae48 expref: 40 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893479.789468:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 19 00000100:00100000:1.0:1787893479.789480:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+40:2391:x1874741481873280:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893479.789530:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893479.789540:0:22749:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae48 expref: 40 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893479.789555:0:22749:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae48 expref: 40 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893479.789691:0:22763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22763:1874741493515648:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893479.789980:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6c00/0x9232577658cf2d9a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae48 expref: 40 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.789981:0:22763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2dbd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893479.790002:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:1.0:1787893479.790007:0:22749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2dbd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893479.790019:0:22749:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2dbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893479.790046:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2dbd lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893479.790079:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893479.790103:0:22763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2dbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.790110:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2dbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893479.790183:0:22763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787893479.790188:0:22763:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1787893479.790192:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+39:2391:x1874741481873280:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 714us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893479.790200:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 19 00000004:00010000:0.0:1787893479.790215:0:22763:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2dbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.790253:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7c00/0x9232577658cf2db6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae56 expref: 39 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.790392:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2dbd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae56 expref: 38 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.790413:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893479.790416:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893479.790419:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9d0ad6e00, rc 0) 00000100:00100000:0.0:1787893479.790452:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+38:18829:x1874741481873152:12345-192.168.202.35@tcp:101:bash.0 Request processed in 4622us (5036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893479.790459:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 53 00000100:00100000:1.0:1787893479.793087:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893479.793160:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481873536 00000100:00100000:2.0:1787893479.793175:0:23919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481873536 00000100:00100000:2.0:1787893479.793256:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:2.0:1787893479.793268:0:23919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+38:18829:x1874741481873536:12345-192.168.202.35@tcp:103:bash.0 00010000:00010000:2.0:1787893479.793296:0:23919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787893479.793431:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1a00/0x9232577658cf2daf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae4f expref: 38 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.793467:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6e00/0x9232577658cf2dbd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae56 expref: 37 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.793480:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893479.793487:0:23919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893479.793980:0:23919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+36:18829:x1874741481873536:12345-192.168.202.35@tcp:103:bash.0 Request processed in 711us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893479.793989:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 3 00000100:00100000:3.0:1787893479.797085:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893479.797981:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481873664 00000100:00100000:0.0:1787893479.797997:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481873664 00000100:00100000:0.0:1787893479.798132:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:0.0:1787893479.798146:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+36:18829:x1874741481873664:12345-192.168.202.35@tcp:58:bash.0 00010000:00010000:0.0:1787893479.798295:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.798325:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.798340:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893479.800996:0:24576:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787893479.801047:0:24576:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1787893479.801243:0:24576:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1787893479.805030:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+36:18829:x1874741481873664:12345-192.168.202.35@tcp:58:bash.0 Request processed in 6867us (7942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893479.805049:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 54 00000100:00100000:1.0:1787893479.807477:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893479.807983:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481873792 00000100:00100000:0.0:1787893479.807998:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481873792 00000100:00100000:0.0:1787893479.808107:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 55 00000100:00100000:0.0:1787893479.808119:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+36:18829:x1874741481873792:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:0.0:1787893479.808146:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893479.808174:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2dcb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae5d expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.808246:0:22764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.808475:0:22764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2dcb lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae5d expref: 37 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.808538:0:22764:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.808555:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2dcb lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae5d expref: 37 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.808702:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893479.808706:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893479.808711:0:22764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2dcb lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae5d expref: 37 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.808720:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1000, rc 0) 00000100:00100000:2.0:1787893479.809101:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+37:18829:x1874741481873792:12345-192.168.202.35@tcp:101:bash.0 Request processed in 982us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893479.809111:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 55 00000040:00080000:0.0:1787893479.921820:0:22796:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787893479.921843:0:22796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893479.921909:0:22796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787893479.921931:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787893479.922288:0:22796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22796:1874741493515776:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893479.922422:0:22796:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c4d87f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893479.927402:0:22796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22796:1874741493515776:192.168.202.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787893479.930010:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893479.930961:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481873920 00000100:00100000:1.0:1787893479.930978:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481873920 00000100:00100000:1.0:1787893479.931184:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:1.0:1787893479.931199:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+37:18831:x1874741481873920:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787893479.931245:0:22765:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787893479.931570:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+37:18831:x1874741481873920:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 373us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893479.931578:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 56 00000100:00100000:1.0:1787893479.946393:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893479.946596:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481874048 00000100:00100000:2.0:1787893479.946611:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481874048 00000100:00100000:2.0:1787893479.946707:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:2.0:1787893479.946720:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+37:18831:x1874741481874048:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787893479.946827:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2dd2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.947131:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.947147:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.951674:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2dd9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.951698:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.951712:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.951744:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2de0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.951753:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2de0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.951760:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2de0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893479.951829:0:22763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787893479.951834:0:22763:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893479.952092:0:22763:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2de0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952106:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952112:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2dd2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952118:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952142:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9d0ad6200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893479.952147:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952155:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2dd2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952169:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc8c7518800) 00010000:00010000:2.0:1787893479.952172:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893479.952177:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2dd2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952183:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2dd2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952200:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952207:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952213:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952219:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9d0ad6a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893479.952222:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952228:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952246:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9fc8c6614300) 00010000:00010000:2.0:1787893479.952248:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893479.952251:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2dd9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952257:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2dd9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952273:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2de0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952278:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2de0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952284:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2de0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952289:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9d0ad7200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893479.952292:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2de0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952298:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2de0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952306:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893479.952308:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893479.952311:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2de0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.952317:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2de0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893479.952523:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+37:18831:x1874741481874048:12345-192.168.202.35@tcp:34:lhsmtool_posix.0 Request processed in 5799us (6139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893479.952539:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 57 00000100:00100000:2.0:1787893479.958539:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893479.958636:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481874304 00000100:00100000:0.0:1787893479.958648:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481874304 00000100:00100000:0.0:1787893479.958712:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:0.0:1787893479.958722:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+37:18831:x1874741481874304:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893479.958742:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893479.958761:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2de7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae64 expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.958883:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2dee lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.958899:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2dee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.958911:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2dee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893479.958931:0:24576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787893479.959271:0:24576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2dee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.959280:0:24576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2dee lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.959286:0:24576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2dee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.959292:0:24576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787893479.959308:0:24576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2dee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.959316:0:24576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2dee lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.959329:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893479.959332:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893479.959337:0:24576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2dee lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.959342:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2dee lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.959390:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2de7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae64 expref: 39 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.959401:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc8c7518800) 00010000:00010000:0.0:1787893479.959404:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893479.959407:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2de7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae64 expref: 39 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893479.959416:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0e00, rc 0) 00000100:00100000:0.0:1787893479.959568:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+38:18831:x1874741481874304:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 846us (1039us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1787893479.959577:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 58 00000100:00100000:3.0:1787893479.967074:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893479.970557:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481874432 00000100:00100000:2.0:1787893479.970575:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481874432 00000100:00100000:2.0:1787893479.970648:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:2.0:1787893479.970660:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+38:18831:x1874741481874432:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787893479.970698:0:22764:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787893479.970840:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+38:18831:x1874741481874432:12345-192.168.202.35@tcp:53:lhsmtool_posix.0 Request processed in 182us (3775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893479.970856:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 59 00000100:00100000:1.0:1787893479.979796:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893479.980210:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481874688 00000100:00100000:3.0:1787893479.980228:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481874688 00000100:00100000:3.0:1787893479.980347:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:3.0:1787893479.980360:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+38:18831:x1874741481874688:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893479.980399:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893479.980430:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7000/0x9232577658cf2dfc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae6b expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893479.981828:0:22765:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:2.0:1787893479.981839:0:22765:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1787893479.982621:0:22765:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1787893479.982843:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2e03 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.982869:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2e03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.982880:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2e03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.982972:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7000/0x9232577658cf2dfc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae6b expref: 41 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.983013:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2e03 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae6b expref: 40 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.983023:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c6614300) 00010000:00010000:2.0:1787893479.983026:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893479.983030:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9d0ad7200, rc 0) 00000100:00100000:2.0:1787893479.983101:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+40:18831:x1874741481874688:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 2743us (3315us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1787893479.983110:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 60 00000100:00100000:3.0:1787893479.990189:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893479.990297:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481874944 00000100:00100000:2.0:1787893479.990313:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481874944 00000100:00100000:2.0:1787893479.990400:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:2.0:1787893479.990413:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+40:18831:x1874741481874944:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893479.990478:0:22764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893479.990547:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2e03 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae6b expref: 40 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990568:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c6614300) 00010000:00010000:2.0:1787893479.990579:0:22764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893479.990603:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2e11 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990617:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2e11 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990626:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2e11 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990655:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e18 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2bd09a48 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990663:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2bd09a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990669:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2bd09a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990718:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2e11 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990726:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2e11 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990733:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2e11 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990739:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9d0ad6a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893479.990744:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2e11 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990751:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2e11 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990759:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:2.0:1787893479.990761:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893479.990765:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2e11 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990770:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6a00/0x9232577658cf2e11 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990786:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2bd09a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990792:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e18 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2bd09a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990808:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e18 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2bd09a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990814:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9d0ad6200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893479.990816:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e18 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2bd09a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990822:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e18 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2bd09a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990830:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x2bd09a48 (ffff9fc8c6614200) 00010000:00010000:2.0:1787893479.990832:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893479.990835:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e18 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2bd09a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893479.990840:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e18 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2bd09a48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893479.991445:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+39:18831:x1874741481874944:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 1032us (1270us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787893479.991455:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 61 00000100:00100000:3.0:1787893480.003370:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893480.003549:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481875072 00000100:00100000:0.0:1787893480.003566:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481875072 00000100:00100000:0.0:1787893480.003646:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:0.0:1787893480.003656:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+39:18831:x1874741481875072:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893480.003693:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893480.003717:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e1f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae72 expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.003753:0:24576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2e26 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.003768:0:24576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2e26 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.003779:0:24576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2e26 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.003904:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e1f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae72 expref: 41 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.003936:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0a00/0x9232577658cf2e26 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae72 expref: 40 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.004228:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c7518700) 00010000:00010000:0.0:1787893480.004231:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787893480.004235:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e0a00, rc 0) 00000100:00100000:0.0:1787893480.004322:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+40:18831:x1874741481875072:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 667us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893480.004329:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 62 00000100:00100000:1.0:1787893480.011262:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893480.011362:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481875328 00000100:00100000:0.0:1787893480.011373:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481875328 00000100:00100000:0.0:1787893480.011438:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:0.0:1787893480.011448:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+40:18831:x1874741481875328:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787893480.011577:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.011595:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.011607:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893480.011777:0:22763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1787893480.011786:0:22763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 723833293982ns, next at 724833291905ns, rc = 0 00000004:00010000:0.0:1787893480.011854:0:22763:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c832d664 reply state 00000000c4338b9b transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.011869:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.011876:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c7518700) 00010000:00010000:0.0:1787893480.011879:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787893480.011882:0:22763:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787893480.011997:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+42:18831:x1874741481875328:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 550us (745us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1787893480.012004:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 63 00000100:00100000:3.0:1787893480.014837:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893480.025932:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481875456 00000100:00100000:2.0:1787893480.025955:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481875456 00000100:00100000:2.0:1787893480.026094:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:2.0:1787893480.026129:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+42:18831:x1874741481875456:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893480.026165:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893480.026193:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e34 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae79 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.026282:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e34 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae79 expref: 43 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.026303:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e34 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae79 expref: 43 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.026329:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c7518700) 00010000:00010000:2.0:1787893480.026332:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893480.026336:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9d0ad6200, rc 0) 00000100:00100000:2.0:1787893480.026435:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+43:18831:x1874741481875456:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 309us (11817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893480.026444:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 64 00000100:00100000:2.0:1787893480.035549:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893480.035784:0:25379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481875584 00000100:00100000:3.0:1787893480.035811:0:25379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481875584 00000100:00100000:3.0:1787893480.035922:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:3.0:1787893480.035939:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2390:x1874741481875584:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787893480.036192:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893480.036563:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2390:x1874741481875584:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 626us (1026us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1787893480.036573:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 24 00000100:00100000:1.0:1787893480.051772:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893480.052108:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481875840 00000100:00100000:0.0:1787893480.052122:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481875840 00000100:00100000:0.0:1787893480.052248:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:0.0:1787893480.052323:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+43:18831:x1874741481875840:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787893480.052726:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+44:18831:x1874741481875840:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 466us (966us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1787893480.052755:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 11 00000100:00100000:2.0:1787893480.059086:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893480.059338:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481876096 00000100:00100000:0.0:1787893480.059353:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481876096 00000100:00100000:0.0:1787893480.059433:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:0.0:1787893480.059559:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+44:18831:x1874741481876096:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787893480.059784:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+44:18831:x1874741481876096:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 341us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893480.059793:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 65 00000100:00100000:1.0:1787893480.066759:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893480.067149:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481876224 00000100:00100000:2.0:1787893480.067164:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481876224 00000100:00100000:2.0:1787893480.067250:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:2.0:1787893480.067263:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+44:18831:x1874741481876224:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893480.067292:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893480.067322:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2e3b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae80 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.067669:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7400/0x9232577658cf2e42 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.067697:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7400/0x9232577658cf2e42 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.067822:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7400/0x9232577658cf2e42 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893480.068217:0:22765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787893480.068248:0:22765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7400/0x9232577658cf2e42 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.068350:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7200/0x9232577658cf2e3b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae80 expref: 46 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.068375:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7400/0x9232577658cf2e42 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae80 expref: 45 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.068387:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c7518700) 00010000:00010000:2.0:1787893480.068390:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787893480.068395:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9d0ad7400, rc 0) 00000100:00100000:2.0:1787893480.068704:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+45:18831:x1874741481876224:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 1441us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893480.068712:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 66 00000100:00100000:3.0:1787893480.071896:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893480.071981:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481876352 00000100:00100000:0.0:1787893480.071997:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481876352 00000100:00100000:0.0:1787893480.072091:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:0.0:1787893480.072104:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+6:2390:x1874741481876352:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893480.072127:0:24270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893480.072156:0:24270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf2e49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae87 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893480.072191:0:24270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9116e8, blocks: 0x0 00010000:00010000:0.0:1787893480.072217:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=723s v=(0 0) 00010000:00010000:0.0:1787893480.072222:0:24270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893480.072235:0:24270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf2e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae87 expref: 7 pid: 24270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.072270:0:24270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf2e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae87 expref: 7 pid: 24270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.072314:0:24270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c67e1a00, rc 0) 00000100:00100000:0.0:1787893480.073220:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:2390:x1874741481876352:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 1111us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893480.073230:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 25 00000100:00100000:3.0:1787893480.077538:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893480.077691:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481876608 00000100:00100000:0.0:1787893480.077706:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481876608 00000100:00100000:0.0:1787893480.077790:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:0.0:1787893480.077813:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+45:18831:x1874741481876608:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787893480.077969:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+45:18831:x1874741481876608:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 168us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893480.077978:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 67 00000100:00100000:1.0:1787893480.086235:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893480.086995:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481876736 00000100:00100000:2.0:1787893480.087009:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481876736 00000100:00100000:2.0:1787893480.087215:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00100000:2.0:1787893480.087248:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+45:18831:x1874741481876736:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787893480.092127:0:22743:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:0.0:1787893480.092150:0:22743:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787893480.092221:0:22743:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1787893480.092387:0:3616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.092404:0:3616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.092411:0:3616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.092416:0:3616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893480.092426:0:3616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.092432:0:3616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.092463:0:3616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:3.0:1787893480.092466:0:3616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787893480.092470:0:3616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.092475:0:3616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729200/0x9232577658cf2c5f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893480.092971:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d0aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493515904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787893480.093064:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893480.093138:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493515904 00000100:00100000:3.0:1787893480.093145:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493515904 00000100:00100000:3.0:1787893480.093202:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787893480.093209:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493515904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787893480.093382:0:24272:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787893480.093386:0:24272:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787893480.093389:0:24272:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787893480.093391:0:24272:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787893480 -> 1787893480 00002000:00010000:3.0:1787893480.093394:0:24272:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1787893480.093812:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093824:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093840:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093847:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893480.093851:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093858:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093875:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc8c6614f00) 00010000:00010000:2.0:1787893480.093877:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893480.093882:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093887:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69dc00/0x9232577658cf2c0b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093916:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093921:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093940:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093944:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893480.093945:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093949:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093956:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:2.0:1787893480.093958:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893480.093959:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093964:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c400/0x9232577658cf2c12 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093975:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093978:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093982:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093986:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69c800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893480.093988:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.093997:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094002:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fc8c6614900) 00010000:00010000:2.0:1787893480.094004:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893480.094005:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094008:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69c800/0x9232577658cf2cba lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094217:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094223:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094227:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094229:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9d0ad6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893480.094232:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094238:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094249:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893480.094251:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893480.094311:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094322:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6400/0x9232577658cf2d3f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094332:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094337:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094343:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094348:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9d0ad6600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893480.094351:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094357:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094366:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893480.094368:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893480.094371:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094377:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6600/0x9232577658cf2d62 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094387:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094394:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094403:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094407:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893480.094409:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094412:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094419:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893480.094421:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893480.094423:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094427:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0200/0x9232577658cf2da8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094436:0:3617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094512:0:3617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094516:0:3617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094519:0:3617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893480.094521:0:3617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094532:0:3617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094539:0:3617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c7518700) 00010000:00010000:2.0:1787893480.094541:0:3617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787893480.094598:0:3617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.094603:0:3617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e0e00/0x9232577658cf2e2d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893480.095318:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+14:18831:x1874741481876736:12345-192.168.202.35@tcp:44:lhsmtool_posix.0 Request processed in 8067us (9092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893480.095329:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 68 00000100:00080000:1.0:1787893480.098657:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893480.099354:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c76f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3632:x1874741493515904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6133us (6278us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787893480.099372:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787893480.099610:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893480.099718:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481876864 00000100:00100000:3.0:1787893480.099730:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481876864 00000100:00100000:3.0:1787893480.099783:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 27 00000100:00100000:3.0:1787893480.099794:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:2391:x1874741481876864:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787893480.099953:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:2391:x1874741481876864:12345-192.168.202.35@tcp:16:lhsmtool_posix.0 Request processed in 160us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893480.099961:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 27 00000004:00080000:0.0:1787893480.102011:0:3632:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc9d0aa4000/2, rc 0, transno 12884901892 00000100:00100000:0.0:1787893480.102034:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d0aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493515904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787893480.103218:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893480.103297:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481877120 00000100:00100000:0.0:1787893480.103313:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481877120 00000100:00100000:0.0:1787893480.103455:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:0.0:1787893480.103470:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+14:18831:x1874741481877120:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787893480.103583:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893480.103638:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7400/0x9232577658cf2e42 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae80 expref: 14 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.103664:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c7518700) 00010000:00010000:0.0:1787893480.103670:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893480.103712:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2e50 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.103729:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2e50 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.103740:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2e50 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893480.103918:0:22763:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e5dded6 reply state 000000004cd3d968 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2e50 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.103932:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69d800/0x9232577658cf2e50 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.103939:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c7518700) 00010000:00010000:0.0:1787893480.103942:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787893480.103945:0:22763:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787893480.104076:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+15:18831:x1874741481877120:12345-192.168.202.35@tcp:36:lhsmtool_posix.0 Request processed in 608us (867us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1787893480.104084:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:2.0:1787893480.108013:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893480.108203:0:25379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481877248 00000100:00100000:1.0:1787893480.108235:0:25379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481877248 00000100:00100000:1.0:1787893480.108323:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:1.0:1787893480.108334:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:18831:x1874741481877248:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893480.108358:0:25379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893480.108385:0:25379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae8e expref: -99 pid: 25379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.108428:0:25379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf2e49 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae87 expref: 8 pid: 24270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.108438:0:25379:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893480.108444:0:25379:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893480.108450:0:25379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 8 pid: 25379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.108555:0:25379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf2e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae87 expref: 8 pid: 24270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.108573:0:25379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf2e49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae87 expref: 8 pid: 24270 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893480.108590:0:25379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d0aa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25379:1874741493516032:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893480.109005:0:25379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c333bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893480.114418:0:3632:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893480.114452:0:3632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c77f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493516160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893480.114611:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893480.114845:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493516160 00000100:00100000:3.0:1787893480.114856:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493516160 00000100:00080000:0.0:1787893480.114940:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893480.114957:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787893480.114971:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493516160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893480.115001:0:24275:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787893480.115731:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3632:x1874741493516160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 761us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893480.115742:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787893480.117435:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893480.117575:0:25379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d0aa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25379:1874741493516032:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893480.117620:0:25379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 8 pid: 25379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.117678:0:25379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd729200, rc 0) 00000100:00100000:1.0:1787893480.117757:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+8:18831:x1874741481877248:12345-192.168.202.35@tcp:101:lhsmtool_posix.0 Request processed in 9424us (9759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893480.117767:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:3.0:1787893480.118038:0:25793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481877376 00000100:00100000:3.0:1787893480.118048:0:25793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481877376 00010000:00010000:3.0:1787893480.118091:0:25793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf2e49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae87 expref: 8 pid: 24270 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893480.118144:0:25793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:3.0:1787893480.118157:0:25793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c77f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd6f19be-6c98-4c86-964a-533d4d057bbd+8:2390:x1874741481877376:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893480.118178:0:25793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893480.118210:0:25793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf2e49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae87 expref: 8 pid: 24270 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.118226:0:25793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf2e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae87 expref: 8 pid: 24270 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.118273:0:25793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fed994f3/0x9232577658cf2e49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae87 expref: 8 pid: 24270 timeout: 823 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.118290:0:25793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893480.118295:0:25793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893480.118303:0:25793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 7 pid: 25379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.118317:0:25793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 7 pid: 25379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.118367:0:25793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 7 pid: 25379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893480.118384:0:25793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25793:1874741493516288:192.168.202.35@tcp:105: 00000100:00100000:3.0:1787893480.118466:0:25793:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c72b2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787893480.123779:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893480.124178:0:25793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:25793:1874741493516288:192.168.202.35@tcp:105: 00010000:00010000:3.0:1787893480.124225:0:25793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893480.124327:0:25793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c77f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:2390:x1874741481877376:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 6170us (6903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893480.124341:0:25793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 20 00000100:00100000:0.0:1787893480.124543:0:3632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c77f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3632:1874741493516160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893480.126436:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481877504 00000100:00100000:1.0:1787893480.126458:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481877504 00000100:00100000:1.0:1787893480.126754:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:1.0:1787893480.126769:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:2390:x1874741481877504:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787893480.127247:0:24270:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787893480.127252:0:24270:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787893479 00002000:00010000:1.0:1787893480.127266:0:24270:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787893478 00002000:00010000:1.0:1787893480.127269:0:24270:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787893480 -> 1787893479 00002000:00010000:1.0:1787893480.127271:0:24270:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787893480.127366:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+8:2390:x1874741481877504:12345-192.168.202.35@tcp:2:lhsmtool_posix.0 Request processed in 598us (3610us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1787893480.127376:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:2.0:1787893480.131244:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893480.131427:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481877632 00000100:00100000:3.0:1787893480.131441:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481877632 00000100:00100000:3.0:1787893480.131531:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:3.0:1787893480.131562:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+8:2392:x1874741481877632:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787893480.131631:0:24272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.131655:0:24272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 8 pid: 25379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.131663:0:24272:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893480.131668:0:24272:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893480.131672:0:24272:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.131719:0:24272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 8 pid: 25379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.131734:0:24272:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 8 pid: 25379 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893480.131748:0:24272:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24272:1874741493516416:192.168.202.35@tcp:104: 00000100:00100000:3.0:1787893480.131850:0:24272:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c72b2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787893480.141989:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893480.142301:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481877760 00000100:00100000:1.0:1787893480.142315:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481877760 00010000:00010000:1.0:1787893480.142375:0:22749:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 9 pid: 25379 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893480.142434:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 21 00000100:00100000:1.0:1787893480.142446:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+9:2391:x1874741481877760:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893480.142466:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893480.142569:0:22749:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 9 pid: 25379 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.142587:0:22749:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 9 pid: 25379 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.142623:0:22749:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893480.142629:0:22749:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893480.142636:0:22749:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.142659:0:22749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.142687:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893480.142752:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+9:2391:x1874741481877760:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 307us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893480.142761:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 21 00010000:00010000:3.0:1787893480.144429:0:24272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb8a87c4/0x9232577658cf2e57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae8e expref: 8 pid: 25379 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893480.144465:0:24272:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24272:1874741493516416:192.168.202.35@tcp:104: 00010000:00010000:3.0:1787893480.144570:0:24272:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.144608:0:24272:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.144615:0:24272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.147781:0:24272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.147818:0:24272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.147828:0:24272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.147986:0:24272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7c00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:3.0:1787893480.147993:0:24272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.148005:0:24272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.148099:0:24272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.148138:0:24272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893480.148435:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c8481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:2392:x1874741481877632:12345-192.168.202.35@tcp:1:lhsmtool_posix.0 Request processed in 16868us (17198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893480.148448:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:2.0:1787893480.151242:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893480.153728:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481878016 00000100:00100000:1.0:1787893480.153749:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481878016 00000100:00100000:1.0:1787893480.153864:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:1.0:1787893480.153877:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+15:18831:x1874741481878016:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787893480.153999:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.154022:0:22765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7e00/0x9232577658cf2d38 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae2c expref: 15 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.154059:0:22765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.154106:0:22765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7e00/0x9232577658cf2d38 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae2c expref: 15 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.154123:0:22765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7e00/0x9232577658cf2d38 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae2c expref: 15 pid: 24576 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893480.154141:0:22765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d0aa4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493516544:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893480.154279:0:22765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c333bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893480.158189:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893480.158227:0:22765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d0aa4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493516544:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893480.158322:0:22765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893480.159815:0:23919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481878144 00000100:00100000:3.0:1787893480.159831:0:23919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481878144 00010000:00010000:0.0:1787893480.160119:0:23919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7e00/0x9232577658cf2d38 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae2c expref: 16 pid: 24576 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893480.160176:0:23919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 22 00000100:00100000:0.0:1787893480.160188:0:23919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+16:2390:x1874741481878144:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893480.160208:0:23919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893480.160216:0:23919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7e00/0x9232577658cf2d38 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae2c expref: 16 pid: 24576 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.160231:0:23919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7e00/0x9232577658cf2d38 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae2c expref: 16 pid: 24576 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.162636:0:23919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad7e00/0x9232577658cf2d38 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae2c expref: 16 pid: 24576 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.162677:0:23919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:0.0:1787893480.162686:0:23919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2dcb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae5d expref: 15 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.162700:0:23919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.162711:0:23919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.162749:0:23919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.162808:0:23919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893480.163105:0:23919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+15:2390:x1874741481878144:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 2916us (4927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893480.163117:0:23919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 22 00010000:00010000:1.0:1787893480.163291:0:22765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.163301:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.163634:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.163651:0:22765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e34 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae79 expref: 15 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.163660:0:22765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.163725:0:22765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e34 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae79 expref: 15 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.163746:0:22765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e34 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae79 expref: 15 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893480.163768:0:22765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9d0aa4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493516672:192.168.202.35@tcp:104: 00000100:00100000:1.0:1787893480.163863:0:22765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c1359780 going to sleep for 11 seconds 00000100:00100000:1.0:1787893480.171311:0:22765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9d0aa4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493516672:192.168.202.35@tcp:104: 00010000:00010000:1.0:1787893480.171533:0:22765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893480.173602:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893480.173902:0:25793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481878272 00000100:00100000:3.0:1787893480.173926:0:25793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481878272 00010000:00010000:3.0:1787893480.173987:0:25793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e34 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae79 expref: 16 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893480.174047:0:25793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 23 00000100:00100000:3.0:1787893480.174060:0:25793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9c759d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd6f19be-6c98-4c86-964a-533d4d057bbd+16:2390:x1874741481878272:12345-192.168.202.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893480.174080:0:25793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893480.174088:0:25793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e34 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae79 expref: 16 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.174103:0:25793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e34 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae79 expref: 16 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.174135:0:25793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9d0ad6200/0x9232577658cf2e34 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae79 expref: 16 pid: 22765 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.174155:0:25793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c7518700) 00010000:00010000:3.0:1787893480.174162:0:25793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.174197:0:25793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.174206:0:25793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.174247:0:25793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893480.174329:0:25793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9c759d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd6f19be-6c98-4c86-964a-533d4d057bbd+15:2390:x1874741481878272:12345-192.168.202.35@tcp:103:ldlm_bl.0 Request processed in 271us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893480.174352:0:25793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 23 00010000:00010000:2.0:1787893480.174688:0:22765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.174698:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893480.174868:0:22765:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1787893480.175010:0:22765:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1787893480.175064:0:22765:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1787893480.175164:0:22765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22765:1874741493516800:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787893480.175234:0:22765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893480.175274:0:22765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9c2d2dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893480.175875:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493516800 00000100:00100000:3.0:1787893480.175884:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493516800 00000100:00100000:3.0:1787893480.176161:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787893480.176173:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22765:x1874741493516800:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787893480.176303:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22765:x1874741493516800:12345-0@lo:1000:mdt00_002.0 Request processed in 132us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893480.176312:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787893480.176669:0:22765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22765:1874741493516800:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787893480.176906:0:22765:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1787893480.177001:0:22765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22765:1874741493516928:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787893480.177092:0:22765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893480.180251:0:22765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787893480.181633:0:23786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493516928 00000100:00100000:0.0:1787893480.181667:0:23786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493516928 00000100:00100000:0.0:1787893480.182739:0:23786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787893480.182754:0:23786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22765:x1874741493516928:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787893480.183875:0:23786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22765:x1874741493516928:12345-0@lo:1000:mdt00_002.0 Request processed in 1117us (6775us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1787893480.183888:0:23786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787893480.184123:0:22765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22765:1874741493516928:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787893480.184196:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184209:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184217:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184224:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd729600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893480.184229:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184237:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184636:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c7518700) 00010000:00010000:2.0:1787893480.184640:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893480.184646:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184654:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd729600/0x9232577658cf2e6c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184702:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184710:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184717:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184723:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c67e1600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787893480.184726:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184733:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184742:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:2.0:1787893480.184745:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893480.184753:0:22765:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2dcb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae5d expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184765:0:22765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2dcb lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae5d expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.184783:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2dcb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae5d expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.187617:0:22765:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1000/0x9232577658cf2dcb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae5d expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893480.187651:0:22765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493517056:192.168.202.35@tcp:105: 00000100:00100000:2.0:1787893480.187922:0:22765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc9fe47f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893480.192649:0:22765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22765:1874741493517056:192.168.202.35@tcp:105: 00010000:00010000:1.0:1787893480.192696:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192710:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c67e1600/0x9232577658cf2dc4 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 24576 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192753:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728800/0x9232577658cf2e73 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192772:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728800/0x9232577658cf2e73 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192786:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728800/0x9232577658cf2e73 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192834:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728800/0x9232577658cf2e73 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192841:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728800/0x9232577658cf2e73 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192848:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728800/0x9232577658cf2e73 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192854:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893480.192859:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728800/0x9232577658cf2e73 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192866:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728800/0x9232577658cf2e73 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192881:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:1.0:1787893480.192884:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893480.192888:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728800/0x9232577658cf2e73 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192895:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728800/0x9232577658cf2e73 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192906:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192913:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192918:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192930:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd728200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787893480.192933:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192938:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192947:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:1.0:1787893480.192949:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787893480.192952:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893480.192957:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd728200/0x9232577658cf2e65 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893480.194820:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+18:18831:x1874741481878016:12345-192.168.202.35@tcp:57:lhsmtool_posix.0 Request processed in 40923us (43575us total) trans 12884901924 rc 0/0 00000100:00100000:1.0:1787893480.194837:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 70 00000020:00080000:1.0:1787893480.194845:0:22765:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787893480.198223:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000040:00080000:0.0:1787893480.200785:0:22796:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787893480.200809:0:22796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893480.200836:0:22796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787893480.200848:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787893480.201857:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481878400 00000100:00100000:1.0:1787893480.201871:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481878400 00000100:00100000:1.0:1787893480.201952:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:1.0:1787893480.201966:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+18:18829:x1874741481878400:12345-192.168.202.35@tcp:49:bash.0 00000100:00100000:1.0:1787893480.202696:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffbdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+18:18829:x1874741481878400:12345-192.168.202.35@tcp:49:bash.0 Request processed in 729us (4484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893480.202705:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 12 00000100:00100000:2.0:1787893480.205281:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893480.209007:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893480.209216:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481878784 00000100:00100000:3.0:1787893480.209231:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481878784 00000100:00100000:3.0:1787893480.209906:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:3.0:1787893480.209935:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+7:18829:x1874741481878784:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893480.209960:0:24273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893480.209993:0:24273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e7a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae95 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893480.210160:0:24273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9116e7, atime: 0x6a9116e6, ctime: 0x6a9116e7, blocks: 0x0 00010000:00010000:3.0:1787893480.210214:0:24273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=724s v=(0 0) 00010000:00010000:3.0:1787893480.210221:0:24273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893480.210235:0:24273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae95 expref: 8 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.210262:0:24273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078ad2a37/0x9232577658cf2e7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae95 expref: 8 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.210280:0:24273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f7c00, rc 0) 00000100:00100000:3.0:1787893480.210905:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd6f19be-6c98-4c86-964a-533d4d057bbd+8:18829:x1874741481878784:12345-192.168.202.35@tcp:101:bash.0 Request processed in 971us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893480.210985:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:0.0:1787893480.211500:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481878656 00000100:00100000:0.0:1787893480.211513:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481878656 00000100:00100000:0.0:1787893480.213774:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 13 00000100:00100000:0.0:1787893480.213793:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+18:18831:x1874741481878656:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787893480.214632:0:22766:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787893480.214678:0:22766:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:0.0:1787893480.214876:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2e81 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.214996:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2e81 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.215011:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2e81 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.215022:0:22766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2e81 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.215030:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2e81 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.215037:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2e81 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.215197:0:22766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787893480.215425:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+20:18831:x1874741481878656:12345-192.168.202.35@tcp:35:lhsmtool_posix.0 Request processed in 1630us (10162us total) trans 12884901926 rc 0/0 00000100:00100000:0.0:1787893480.215437:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 13 00000020:00080000:0.0:1787893480.215444:0:22766:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787893480.218148:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893480.218241:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481878912 00000100:00100000:3.0:1787893480.218265:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481878912 00000100:00100000:3.0:1787893480.218355:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:3.0:1787893480.218368:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+20:18829:x1874741481878912:12345-192.168.202.35@tcp:101:bash.0 00010000:00010000:3.0:1787893480.218399:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893480.218427:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2e88 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62fae9c expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.218475:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf2e8f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.218519:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf2e8f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.218536:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf2e8f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.218724:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2e88 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae9c expref: 22 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.218747:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6800/0x9232577658cf2e8f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62fae9c expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.218758:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:3.0:1787893480.218761:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893480.218764:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc8c84f6800, rc 0) 00000100:00100000:3.0:1787893480.218851:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+21:18829:x1874741481878912:12345-192.168.202.35@tcp:101:bash.0 Request processed in 486us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893480.218858:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 71 00010000:00010000:2.0:1787893480.219289:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893480.219299:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2e81 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.219308:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc9dd69ce00 already unused, calling callback (ffffffffc0cb7230) 00010000:00010000:2.0:1787893480.219313:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2e81 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.219322:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2e81 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.219467:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc8c7518700) 00010000:00010000:2.0:1787893480.219471:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787893480.219475:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2e81 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.219481:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ce00/0x9232577658cf2e81 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893480.219538:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893480.219540:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893480.219542:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893480.225712:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:2.0:1787893480.225905:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481879168 00000100:00100000:2.0:1787893480.225928:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481879168 00000100:00100000:2.0:1787893480.225999:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 14 00000100:00100000:2.0:1787893480.226012:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+21:18829:x1874741481879168:12345-192.168.202.35@tcp:35:bash.0 00000001:00080000:2.0:1787893480.226312:0:22767:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1787893480.226410:0:22767:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1787893480.226577:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+24:18829:x1874741481879168:12345-192.168.202.35@tcp:35:bash.0 Request processed in 566us (887us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1787893480.226587:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 14 00000020:00080000:2.0:1787893480.226593:0:22767:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787893480.346181:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:0.0:1787893480.346309:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481879424 00000100:00100000:0.0:1787893480.346325:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481879424 00000100:00100000:0.0:1787893480.346424:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:0.0:1787893480.346437:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+24:18841:x1874741481879424:12345-192.168.202.35@tcp:101:lfs.0 00010000:00010000:0.0:1787893480.346472:0:24576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893480.346547:0:24576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2e96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x18f6ecdea62faea3 expref: -99 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893480.346888:0:24576:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787893480.347241:0:24576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2e96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faea3 expref: 26 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.347263:0:24576:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc8c6614c00) 00010000:00010000:0.0:1787893480.347267:0:24576:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893480.347273:0:24576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc9dd69ca00/0x9232577658cf2e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.35@tcp remote: 0x18f6ecdea62faea3 expref: 26 pid: 24576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893480.347293:0:24576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc9dd69ca00, rc 0) 00000100:00100000:0.0:1787893480.347571:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+25:18841:x1874741481879424:12345-192.168.202.35@tcp:101:lfs.0 Request processed in 1136us (1406us total) trans 12884901930 rc 301/301 00000100:00100000:0.0:1787893480.347580:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:1.0:1787893480.353206:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893480.353819:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481879552 00000100:00100000:3.0:1787893480.353836:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481879552 00000100:00100000:3.0:1787893480.354030:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:3.0:1787893480.354046:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+25:18841:x1874741481879552:12345-192.168.202.35@tcp:34:lfs.0 00010000:00010000:3.0:1787893480.354160:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2ea4 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354182:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2ea4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354197:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2ea4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354215:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6200/0x9232577658cf2eab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354247:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6200/0x9232577658cf2eab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354264:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6200/0x9232577658cf2eab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354389:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf2eb2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354400:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf2eb2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354406:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf2eb2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893480.354470:0:22764:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf2eb2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354483:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2ea4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354523:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2ea4 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354532:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2ea4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354539:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f7400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893480.354544:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2ea4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354562:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2ea4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354586:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc8c6614600) 00010000:00010000:3.0:1787893480.354589:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893480.354595:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2ea4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354602:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f7400/0x9232577658cf2ea4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354618:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6200/0x9232577658cf2eab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354624:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6200/0x9232577658cf2eab lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354630:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6200/0x9232577658cf2eab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354636:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893480.354650:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6200/0x9232577658cf2eab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354658:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6200/0x9232577658cf2eab lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354666:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fc9d5c29600) 00010000:00010000:3.0:1787893480.354668:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893480.354671:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6200/0x9232577658cf2eab lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354677:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6200/0x9232577658cf2eab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354716:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf2eb2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354723:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf2eb2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354729:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf2eb2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354734:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc8c84f6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787893480.354737:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf2eb2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354744:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf2eb2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354752:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc8c6614d00) 00010000:00010000:3.0:1787893480.354754:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893480.354757:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf2eb2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893480.354763:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc8c84f6400/0x9232577658cf2eb2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893480.354890:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+25:18841:x1874741481879552:12345-192.168.202.35@tcp:34:lfs.0 Request processed in 845us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893480.354899:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 73 00000100:00100000:1.0:1787893480.357601:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893480.358025:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481879808 00000100:00100000:3.0:1787893480.358040:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481879808 00000100:00100000:3.0:1787893480.358106:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 15 00000100:00100000:3.0:1787893480.358137:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+25:18841:x1874741481879808:12345-192.168.202.35@tcp:35:lfs.0 00000100:00100000:3.0:1787893480.358479:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+26:18841:x1874741481879808:12345-192.168.202.35@tcp:35:lfs.0 Request processed in 345us (890us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1787893480.358488:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 15 00010000:00010000:0.0:1787893480.561735:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893481.138118:0:3631:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893481.138151:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493517184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893481.138250:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893481.141244:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493517184 00000100:00100000:1.0:1787893481.141267:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493517184 00000100:00100000:1.0:1787893481.141353:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787893481.141363:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493517184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893481.141407:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787893481.141517:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3631:x1874741493517184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (3268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893481.141522:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787893481.143064:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493517312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787893481.143131:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893481.143194:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c76f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3631:1874741493517184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893481.143359:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493517312 00000100:00100000:1.0:1787893481.143367:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493517312 00000100:00100000:1.0:1787893481.143425:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787893481.143433:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493517312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787893481.143454:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787893481.143520:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493517312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893481.143525:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787893481.143889:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493517568:0@lo:400:kworker.0 00000100:00100000:3.0:1787893481.144051:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893481.144075:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493518080:0@lo:400:kworker.0 00000100:00100000:3.0:1787893481.144102:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893481.144119:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493518592:0@lo:400:kworker.0 00000100:00100000:3.0:1787893481.144147:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893481.144167:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787893481.144172:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afca6d2b-351c-4adb-95b2-d9dd13744042:3633:1874741493517440:0@lo:400:kworker.0 00000100:00100000:3.0:1787893481.144202:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893481.144231:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493517952:0@lo:400:kworker.0 00000100:00100000:3.0:1787893481.144253:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893481.144272:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493518464:0@lo:400:kworker.0 00000100:00100000:3.0:1787893481.144292:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893481.144323:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493517440 00000100:00100000:3.0:1787893481.144330:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493517440 00000100:00100000:3.0:1787893481.144375:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787893481.144384:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+24:3633:x1874741493517440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893481.144427:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afca6d2b-351c-4adb-95b2-d9dd13744042+24:3633:x1874741493517440:12345-0@lo:400:kworker.0 Request processed in 44us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893481.144434:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787893481.144595:0:25379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493518080 00000100:00100000:1.0:1787893481.144601:0:25379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493518080 00000100:00100000:1.0:1787893481.144639:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787893481.144648:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493518080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.144687:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493518080:12345-0@lo:400:kworker.0 Request processed in 41us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893481.144694:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787893481.144717:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493517568 00000100:00100000:1.0:1787893481.144720:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493517568 00000100:00100000:1.0:1787893481.144751:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493517952 00000100:00100000:1.0:1787893481.144755:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493517952 00000100:00100000:1.0:1787893481.144769:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787893481.144775:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493517568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.144833:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1874741493517568:12345-0@lo:400:kworker.0 Request processed in 48us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893481.144840:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787893481.144853:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787893481.144859:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493517952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.144888:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1874741493517952:12345-0@lo:400:kworker.0 Request processed in 29us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893481.144894:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787893481.145051:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493518592 00000100:00100000:1.0:1787893481.145056:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493518592 00000100:00100000:1.0:1787893481.145089:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493518464 00000100:00100000:1.0:1787893481.145092:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493518464 00000100:00100000:1.0:1787893481.145112:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787893481.145120:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493518592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.145157:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874741493518592:12345-0@lo:400:kworker.0 Request processed in 39us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893481.145163:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787893481.145175:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787893481.145181:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493518464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.145226:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874741493518464:12345-0@lo:400:kworker.0 Request processed in 45us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893481.145234:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787893481.145299:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493517696:0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.145345:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893481.145372:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493518208:0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.145397:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893481.145412:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493518720:0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.145434:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893481.145453:0:3630:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787893481.145459:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493517824:0@lo:400:kworker.0 00000100:00100000:0.0:1787893481.145598:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493518208 00000100:00100000:0.0:1787893481.145604:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493518208 00000100:00100000:0.0:1787893481.145629:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493518720 00000100:00100000:0.0:1787893481.145633:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493518720 00000100:00100000:0.0:1787893481.145651:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787893481.145657:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493518208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893481.145697:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3630:x1874741493518208:12345-0@lo:400:kworker.0 Request processed in 40us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893481.145703:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787893481.145717:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787893481.145723:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493518720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893481.145751:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3630:x1874741493518720:12345-0@lo:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893481.145757:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787893481.145801:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493517696 00000100:00100000:0.0:1787893481.145805:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493517696 00000100:00100000:0.0:1787893481.145851:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787893481.145859:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493517696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893481.145893:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3630:x1874741493517696:12345-0@lo:400:kworker.0 Request processed in 35us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893481.145900:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787893481.145994:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:afca6d2b-351c-4adb-95b2-d9dd13744042:3633:1874741493517440:0@lo:400:kworker.0 00000100:00100000:0.0:1787893481.146011:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493517952:0@lo:400:kworker.0 00010000:00080000:0.0:1787893481.146027:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffbdf800 x1874741493518464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893481.146038:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3633:1874741493518464:0@lo:400:kworker.0 00000100:00100000:0.0:1787893481.146050:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3633:1874741493517568:0@lo:400:kworker.0 00000100:00100000:0.0:1787893481.146062:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3633:1874741493518080:0@lo:400:kworker.0 00000100:00100000:0.0:1787893481.146074:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc8c8507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3633:1874741493518592:0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.146611:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893481.146640:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9ffbdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493518336:0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.146681:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893481.146725:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3630:1874741493517696:0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.146738:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3630:1874741493518208:0@lo:400:kworker.0 00010000:00080000:1.0:1787893481.146750:0:3630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc9ffc5f800 x1874741493518720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893481.146759:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffc5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3630:1874741493518720:0@lo:400:kworker.0 00000100:00080000:2.0:1787893481.147596:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787893481.147605:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893481.147610:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893481.147613:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893481.147680:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493517312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787893481.147844:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493517824 00000100:00100000:0.0:1787893481.147852:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493517824 00000100:00100000:0.0:1787893481.148032:0:24576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493518336 00000100:00100000:0.0:1787893481.148036:0:24576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493518336 00000100:00100000:0.0:1787893481.148082:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787893481.148093:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9d0aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493517824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893481.148191:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9d0aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3630:x1874741493517824:12345-0@lo:400:kworker.0 Request processed in 99us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893481.148199:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787893481.148229:0:24576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787893481.148235:0:24576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493518336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893481.148264:0:24576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3630:x1874741493518336:12345-0@lo:400:kworker.0 Request processed in 30us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893481.148269:0:24576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787893481.148330:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893481.150092:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3630:1874741493517824:0@lo:400:kworker.0 00000100:00100000:1.0:1787893481.150113:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9ffbdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3630:1874741493518336:0@lo:400:kworker.0 00000040:00080000:3.0:1787893481.225705:0:22796:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787893481.225718:0:22796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893481.225761:0:22796:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787893481.225774:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1787893481.592147:0:24298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787893482.084864:0:25847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1787893482.609808:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893483.549137:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893483.549197:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893483.549220:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481879936 00000100:00100000:3.0:1787893483.549233:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893483.549236:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481879936 00000100:00100000:3.0:1787893483.549276:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893483.549299:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893483.549312:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 169 00000100:00100000:3.0:1787893483.549331:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893483.549331:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc8c7cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+13:2393:x1874741481879936:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:3.0:1787893483.549355:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:3.0:1787893483.549385:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893483.549435:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc8c7cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d609832-c190-4f05-b711-9e10bcf3662d+13:2393:x1874741481879936:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 111us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893483.549462:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 169 00000100:00100000:1.0:1787893483.549545:0:25379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481880448 00000100:00100000:1.0:1787893483.549551:0:25379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481880448 00000100:00100000:1.0:1787893483.549600:0:25379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481880960 00000100:00100000:1.0:1787893483.549604:0:25379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481880960 00000100:00100000:1.0:1787893483.549618:0:25379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481880320 00000100:00100000:1.0:1787893483.549621:0:25379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481880320 00000100:00100000:1.0:1787893483.549640:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:1.0:1787893483.549647:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+8:2393:x1874741481880448:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:0.0:1787893483.549799:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 29 00000100:00100000:0.0:1787893483.549814:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd12447e-462e-44ae-80f0-d0642d80e472+5:2393:x1874741481880960:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893483.554755:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+8:2393:x1874741481880448:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 5077us (5490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893483.554784:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 28 00000100:00100000:1.0:1787893483.554959:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00100000:1.0:1787893483.554978:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2393:x1874741481880320:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893483.555044:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2393:x1874741481880320:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 75us (5689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893483.555051:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 30 00000100:00080000:1.0:1787893483.555102:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787893483.555108:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893483.555558:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481880192 00000100:00100000:2.0:1787893483.555574:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481880192 00000100:00080000:1.0:1787893483.555643:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787893483.555653:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481880704 00000100:00100000:2.0:1787893483.555659:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481880704 00000100:00100000:2.0:1787893483.555685:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481880064 00000100:00100000:2.0:1787893483.555689:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481880064 00000100:00100000:2.0:1787893483.555701:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481880576 00000100:00100000:2.0:1787893483.555703:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481880576 00000100:00100000:2.0:1787893483.555723:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:2.0:1787893483.555732:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2393:x1874741481880192:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893483.555822:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+5:2393:x1874741481880192:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 90us (6624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893483.555829:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 69 00000100:00100000:2.0:1787893483.555847:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:2.0:1787893483.555854:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+5:2393:x1874741481880704:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893483.555880:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+5:2393:x1874741481880704:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 27us (6605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893483.555886:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 70 00000100:00100000:2.0:1787893483.555897:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:2.0:1787893483.555902:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+26:2393:x1874741481880064:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893483.555928:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd6f19be-6c98-4c86-964a-533d4d057bbd+26:2393:x1874741481880064:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 26us (6602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893483.555933:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 71 00000100:00100000:2.0:1787893483.555944:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00100000:2.0:1787893483.555950:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9ffc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+6:2393:x1874741481880576:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:2.0:1787893483.555992:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd12447e-462e-44ae-80f0-d0642d80e472+6:2393:x1874741481880576:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 42us (6606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893483.555999:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 72 00000100:00080000:1.0:1787893483.556894:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893483.556903:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787893483.557234:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893483.558032:0:25379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481880832 00000100:00100000:1.0:1787893483.558043:0:25379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481880832 00000100:00100000:1.0:1787893483.558119:0:25379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00100000:1.0:1787893483.558129:0:25379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd12447e-462e-44ae-80f0-d0642d80e472+5:2393:x1874741481880832:12345-192.168.202.35@tcp:400:kworker.0 00000100:00100000:1.0:1787893483.558204:0:25379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd12447e-462e-44ae-80f0-d0642d80e472+5:2393:x1874741481880832:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 76us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893483.558212:0:25379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 31 00000100:00080000:2.0:1787893483.558629:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893483.597342:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9ffc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd12447e-462e-44ae-80f0-d0642d80e472+5:2393:x1874741481880960:12345-192.168.202.35@tcp:400:kworker.0 Request processed in 47514us (48020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893483.597365:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 29 00010000:00010000:0.0:1787893483.635599:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893484.064220:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893484.064296:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.35@tcp (source: 12345-192.168.202.35@tcp) 00000100:00100000:1.0:1787893484.064340:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481881216 00000100:00100000:1.0:1787893484.064352:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481881216 00000100:00100000:1.0:1787893484.064422:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:1.0:1787893484.064436:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+8:2392:x1874741481881216:12345-192.168.202.35@tcp:16:kworker.0 00000100:00100000:1.0:1787893484.064622:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+8:2392:x1874741481881216:12345-192.168.202.35@tcp:16:kworker.0 Request processed in 190us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893484.064631:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 32 00000100:00100000:2.0:1787893484.066619:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741481881088 00000100:00100000:2.0:1787893484.066638:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741481881088 00002000:00100000:2.0:1787893484.066719:0:24276:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9fc9e5a8f100 x1874741481881088/t0(0) o4->dd6f19be-6c98-4c86-964a-533d4d057bbd@192.168.202.35@tcp:645/0 lens 504/0 e 0 to 0 dl 1787893495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787893484.066733:0:24276:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9e5a8f100 with x1874741481881088 ext(0->8) 00002000:00010000:2.0:1787893484.066740:0:24276:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc9e5a8f100 00000100:00100000:2.0:1787893484.066791:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.35@tcp, seq: 0 00000100:00100000:2.0:1787893484.066803:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+8:2392:x1874741481881088:12345-192.168.202.35@tcp:4:bash.0 00000100:00100000:2.0:1787893484.069144:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd6f19be-6c98-4c86-964a-533d4d057bbd+10:2392:x1874741481881088:12345-192.168.202.35@tcp:4:bash.0 Request processed in 2328us (4926us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787893484.069163:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.35@tcp, seq: 0 00002000:00100000:2.0:1787893484.069180:0:24276:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9fc9e5a8f100 x1874741481881088/t12884901895(0) o4->dd6f19be-6c98-4c86-964a-533d4d057bbd@192.168.202.35@tcp:645/0 lens 504/448 e 0 to 0 dl 1787893495 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787893484.069191:0:24276:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc9e5a8f100 with x1874741481881088 ext(0->8) 00002000:00010000:2.0:1787893484.069199:0:24276:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fc9e5a8f100 00000100:00100000:2.0:1787893484.213362:0:3631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc9e5f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493518848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787893484.213460:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893484.213566:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741493518848 00000100:00100000:2.0:1787893484.213576:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741493518848 00000100:00100000:2.0:1787893484.213674:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787893484.213685:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc9e5f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493518848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787893484.213725:0:24274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787893484.213793:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc9e5f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3631:x1874741493518848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893484.213801:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787893484.213825:0:22759:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893484.213871:0:3631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc9e5f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3631:1874741493518848:0@lo:13:osp-pre-0-1.0 Debug log: 14810 lines, 14810 kept, 0 dropped, 0 bad.