00000100:00100000:2.0F:1783137983.354037:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175893248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783137983.354150:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1783137983.354307:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175893248 00000100:00100000:0.0:1783137983.354352:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175893248 00000100:00100000:0.0:1783137983.354401:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783137983.354410:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0422fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175893248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783137983.354452:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783137983.354519:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0422fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175893248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137983.354527:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783137983.354646:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175893248:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783137983.611253:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783137984.381292:0:17160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1783137984.381346:0:17160:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e3f36579240 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:2.0:1783137984.381353:0:17160:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9e3e01f65800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e3f365793c0 00000020:00080000:2.0:1783137984.381357:0:17160:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9e3e01f65300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e3e0343f400 00000020:00080000:2.0:1783137984.381395:0:17219:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:2.0:1783137984.381472:0:17219:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0F:1783137984.383282:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4caf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137984.383308:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4caf0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137984.383338:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4caf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137984.383344:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028ff600 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:1.0:1783137984.383350:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4caf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137984.383357:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4caf0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137984.383377:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e3e03624900) 00010000:00010000:1.0:1783137984.383380:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137984.383386:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4caf0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137984.383392:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4caf0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17182 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783137984.569655:0:17214:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783137984.569666:0:17214:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137984.569688:0:17214:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783137984.569694:0:17214:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1783137984.636746:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137985.291414:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783137985.291459:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783137985.291489:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783137985.291522:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157983872 00000100:00100000:1.0:1783137985.291533:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157983872 00000100:00100000:1.0:1783137985.291585:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:1.0:1783137985.291597:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:239553a0-fafa-47a5-8e48-0f5f76715990+13:2401:x1869755157983872:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783137985.291665:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:239553a0-fafa-47a5-8e48-0f5f76715990+13:2401:x1869755157983872:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137985.291687:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:1.0:1783137985.291723:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157984128 00000100:00100000:1.0:1783137985.291728:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157984128 00000100:00100000:1.0:1783137985.291762:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157984000 00000100:00100000:1.0:1783137985.291765:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157984000 00000100:00100000:1.0:1783137985.291783:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:1.0:1783137985.291790:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:2401:x1869755157984128:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783137985.291822:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:2401:x1869755157984128:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137985.291829:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:1.0:1783137985.291842:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:1.0:1783137985.291848:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+13:2401:x1869755157984000:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783137985.291869:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+13:2401:x1869755157984000:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 22us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137985.291875:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00080000:1.0:1783137985.291992:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783137985.291995:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783137985.309964:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783137985.310003:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783137985.310022:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783137985.310043:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783137985.310061:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783137985.310093:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783137985.310120:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157984512 00000100:00100000:0.0:1783137985.310131:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157984512 00000100:00100000:0.0:1783137985.310190:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157984640 00000100:00100000:0.0:1783137985.310193:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157984640 00000100:00100000:0.0:1783137985.310218:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:0.0:1783137985.310227:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b20e0912-b8b7-4542-a41b-c590a4cc7df2+6:2403:x1869755157984512:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1783137985.310299:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b20e0912-b8b7-4542-a41b-c590a4cc7df2+6:2403:x1869755157984512:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 73us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137985.310306:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:0.0:1783137985.311218:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:0.0:1783137985.311230:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b20e0912-b8b7-4542-a41b-c590a4cc7df2+5:2402:x1869755157984640:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1783137985.311281:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b20e0912-b8b7-4542-a41b-c590a4cc7df2+5:2402:x1869755157984640:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 55us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137985.311287:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:0.0:1783137985.311331:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157984256 00000100:00100000:0.0:1783137985.311336:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157984256 00000100:00100000:0.0:1783137985.311363:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157984384 00000100:00100000:0.0:1783137985.311366:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157984384 00000100:00100000:2.0:1783137985.312064:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157984768 00000100:00100000:2.0:1783137985.312082:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157984768 00000100:00100000:2.0:1783137985.312110:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157984896 00000100:00100000:2.0:1783137985.312112:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157984896 00000100:00100000:2.0:1783137985.312130:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:2.0:1783137985.312137:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:2399:x1869755157984256:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:2.0:1783137985.312159:0:18684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c81f 00000100:00080000:2.0:1783137985.312175:0:18684:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783137985.312238:0:18684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1783137985.312492:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:632e5dd9-edc0-4444-905b-03ec5dccf51c+2:2399:x1869755157984256:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 353us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137985.312499:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:2.0:1783137985.312515:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:2.0:1783137985.312522:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b20e0912-b8b7-4542-a41b-c590a4cc7df2+5:2399:x1869755157984768:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:2.0:1783137985.312535:0:18684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c85e 00000100:00080000:2.0:1783137985.312540:0:18684:0:(import.c:65:import_set_state_nolock()) ffff9e3e048fe000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783137985.312565:0:18684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1783137985.312628:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b20e0912-b8b7-4542-a41b-c590a4cc7df2+2:2399:x1869755157984768:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 106us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137985.312636:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:2.0:1783137985.312648:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:2.0:1783137985.312655:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b20e0912-b8b7-4542-a41b-c590a4cc7df2+5:2399:x1869755157984896:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:2.0:1783137985.312667:0:18684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c865 00000100:00080000:2.0:1783137985.312673:0:18684:0:(import.c:65:import_set_state_nolock()) ffff9e3f043b1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783137985.312695:0:18684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1783137985.312761:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b20e0912-b8b7-4542-a41b-c590a4cc7df2+2:2399:x1869755157984896:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 105us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137985.312768:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00010000:00010000:2.0:1783137985.312790:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137985.312796:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137985.312800:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137985.313637:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1783137985.313646:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:2402:x1869755157984384:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1783137985.313687:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:2402:x1869755157984384:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 42us (3684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137985.313694:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00080000:0.0:1783137985.313716:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783137985.313720:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783137985.313723:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783137985.313725:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783137985.658605:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1783137986.227394:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137986.227450:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157985024 00000100:00100000:3.0:1783137986.227460:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157985024 00000100:00100000:3.0:1783137986.227520:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:3.0:1783137986.227530:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0371d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+13:15611:x1869755157985024:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783137986.227632:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0371d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+13:15611:x1869755157985024:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 103us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137986.227639:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:2.0:1783137986.239177:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137986.239233:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157985152 00000100:00100000:3.0:1783137986.239244:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157985152 00000100:00100000:3.0:1783137986.240490:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:3.0:1783137986.240504:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:15611:x1869755157985152:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783137986.240614:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:15611:x1869755157985152:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 113us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137986.240621:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:2.0:1783137986.250963:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783137986.251028:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157985408 00000100:00100000:0.0:1783137986.251038:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157985408 00000100:00100000:0.0:1783137986.251100:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1783137986.251109:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:632e5dd9-edc0-4444-905b-03ec5dccf51c+13:15611:x1869755157985408:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783137986.251402:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:632e5dd9-edc0-4444-905b-03ec5dccf51c+14:15611:x1869755157985408:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 293us (448us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1783137986.251410:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00010000:00010000:2.0:1783137986.681541:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137986.937659:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783137986.937685:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175893376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783137986.937756:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137986.937927:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175893376 00000100:00100000:2.0:1783137986.937936:0:18688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175893376 00000100:00100000:2.0:1783137986.937996:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783137986.938006:0:18688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0371f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175893376:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783137986.938007:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1783137986.938033:0:18688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1783137986.938099:0:18688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0371f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175893376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137986.938107:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783137986.938435:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175893760:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.938467:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137986.938486:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f361d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175894272:0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.938505:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175893888:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.938517:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137986.938534:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0427ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869755175894784:0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.938543:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137986.938554:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137986.938567:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175894400:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.938569:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783137986.938573:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175893632:0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.938586:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137986.938600:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137986.938601:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869755175894912:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.938620:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175894144:0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.938630:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137986.938636:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137986.938646:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869755175894656:0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.938648:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783137986.938653:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0371fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3660:1869755175893504:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.938674:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137986.938676:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137986.938693:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175894016:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.938699:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175894784 00000100:00100000:3.0:1783137986.938703:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175894784 00000100:00100000:0.0:1783137986.938711:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137986.938721:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175894528:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.938729:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175894400 00000100:00100000:3.0:1783137986.938732:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175894400 00000100:00100000:0.0:1783137986.938737:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137986.938743:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175894912 00000100:00100000:3.0:1783137986.938745:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175894912 00000100:00100000:3.0:1783137986.938756:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175894656 00000100:00100000:3.0:1783137986.938758:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175894656 00000100:00100000:3.0:1783137986.938769:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175894016 00000100:00100000:3.0:1783137986.938772:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175894016 00000100:00100000:3.0:1783137986.938782:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175894528 00000100:00100000:3.0:1783137986.938784:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175894528 00000100:00100000:0.0:1783137986.938784:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175893760 00000100:00100000:0.0:1783137986.938786:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175893760 00000100:00100000:3.0:1783137986.938797:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783137986.938803:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0427ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869755175894784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.938807:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175894272 00000100:00100000:0.0:1783137986.938809:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175894272 00000100:00100000:0.0:1783137986.938819:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175893888 00000100:00100000:0.0:1783137986.938822:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175893888 00000100:00100000:0.0:1783137986.938835:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783137986.938840:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0427ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175893760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.938876:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0427ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175893760:12345-0@lo:400:kworker.0 Request processed in 36us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137986.938883:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783137986.938896:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783137986.938902:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0427c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175894272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.938927:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0427c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175894272:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137986.938939:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783137986.938950:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783137986.938956:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175893888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.938962:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0427ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869755175894784:12345-0@lo:400:kworker.0 Request processed in 159us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137986.938968:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783137986.938978:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175893888:12345-0@lo:400:kworker.0 Request processed in 23us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137986.938980:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783137986.938984:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783137986.938985:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0392d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175894400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.939001:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175893632 00000100:00100000:0.0:1783137986.939004:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175893632 00000100:00100000:3.0:1783137986.939009:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0392d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175894400:12345-0@lo:400:kworker.0 Request processed in 24us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137986.939015:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783137986.939018:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175894144 00000100:00100000:0.0:1783137986.939020:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175894144 00000100:00100000:3.0:1783137986.939024:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783137986.939031:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783137986.939035:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869755175894912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.939035:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175893632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.939071:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175893632:12345-0@lo:400:kworker.0 Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137986.939072:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869755175894912:12345-0@lo:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137986.939079:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783137986.939079:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783137986.939091:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783137986.939091:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783137986.939097:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869755175894656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.939097:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175894144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.939122:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869755175894656:12345-0@lo:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137986.939122:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175894144:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137986.939128:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783137986.939129:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783137986.939139:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783137986.939144:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175894016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.939149:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783137986.939154:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175894528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.939166:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175894016:12345-0@lo:400:kworker.0 Request processed in 22us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137986.939172:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783137986.939175:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175894528:12345-0@lo:400:kworker.0 Request processed in 21us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137986.939179:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783137986.939190:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175893504 00000100:00100000:3.0:1783137986.939193:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175893504 00000100:00100000:3.0:1783137986.939213:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783137986.939218:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+24:3660:x1869755175893504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.939218:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175894016:0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.939228:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175894528:0@lo:400:kworker.0 00000100:00100000:0.0:1783137986.939236:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175893888:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.939243:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+24:3660:x1869755175893504:12345-0@lo:400:kworker.0 Request processed in 26us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137986.939249:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783137986.939293:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175893632:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.939302:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175894144:0@lo:400:kworker.0 00010000:00080000:3.0:1783137986.939337:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f362d0a80 x1869755175894656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137986.939358:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869755175894656:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.939370:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175893760:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.939379:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f361d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175894272:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.939387:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0427ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869755175894784:0@lo:400:kworker.0 00000100:00080000:1.0:1783137986.939625:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783137986.939630:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137986.939632:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783137986.939634:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137986.939649:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175895040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783137986.939683:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137986.939743:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175893376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783137986.940033:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175894400:0@lo:400:kworker.0 00010000:00080000:0.0:1783137986.940047:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e0427d180 x1869755175894912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137986.940057:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0427d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869755175894912:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.940089:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175895040 00000100:00100000:3.0:1783137986.940094:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175895040 00000100:00100000:0.0:1783137986.940094:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0371fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3660:1869755175893504:0@lo:400:kworker.0 00000100:00100000:3.0:1783137986.940127:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783137986.940135:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175895040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137986.940150:0:18689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783137986.940389:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175895040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 254us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137986.940396:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783137986.943892:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175895040:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783137987.705831:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137987.961787:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137987.961812:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175895168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783137987.961884:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137987.962026:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175895168 00000100:00100000:0.0:1783137987.962034:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175895168 00000100:00100000:0.0:1783137987.962096:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783137987.962105:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175895168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783137987.962269:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1783137987.962352:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175895168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 247us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137987.962359:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783137987.962442:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175895168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783137987.962748:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783137987.962759:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175895296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137987.962792:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137987.962864:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175895296 00000100:00100000:0.0:1783137987.962870:0:18688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175895296 00000100:00100000:0.0:1783137987.962904:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783137987.962911:0:18688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175895296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137987.962931:0:18688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783137987.963038:0:18688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175895296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137987.963044:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783137987.963099:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175895296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137987.963380:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783137987.963389:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175895424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783137987.963417:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137987.963442:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175895424 00000100:00100000:1.0:1783137987.963445:0:18688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175895424 00000100:00100000:1.0:1783137987.963537:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783137987.963545:0:18688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175895424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783137987.963556:0:18688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783137987.963587:0:18688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175895424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137987.963593:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783137987.963623:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175895424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783137988.481643:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175895552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783137988.481719:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137988.481826:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175895552 00000100:00100000:0.0:1783137988.481835:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175895552 00000100:00100000:0.0:1783137988.481895:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783137988.481905:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175895552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783137988.481958:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783137988.482018:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175895552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137988.482026:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783137988.482189:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175895552:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783137988.729472:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783137989.245028:0:17933:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783137989.754483:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783137990.018961:0:17160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:3.0:1783137990.018980:0:17160:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:2.0:1783137990.019053:0:17219:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:2.0:1783137990.019066:0:17219:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000001:02000400:2.0:1783137990.289234:0:20553:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 00:06:28 (1783137988) 00000100:00100000:3.0:1783137990.413733:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137990.413772:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137990.413799:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137990.413835:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137990.413858:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137990.413881:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137990.413909:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157985792 00000100:00100000:3.0:1783137990.413942:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157985792 00000100:00100000:3.0:1783137990.413994:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157986048 00000100:00100000:3.0:1783137990.413997:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157986048 00000100:00100000:3.0:1783137990.414011:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157985664 00000100:00100000:3.0:1783137990.414013:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157985664 00000100:00100000:3.0:1783137990.414024:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157986176 00000100:00100000:3.0:1783137990.414026:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157986176 00000100:00100000:3.0:1783137990.414053:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:3.0:1783137990.414063:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:2400:x1869755157985792:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1783137990.414136:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:2400:x1869755157985792:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 74us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137990.414143:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:3.0:1783137990.414161:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:3.0:1783137990.414166:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b20e0912-b8b7-4542-a41b-c590a4cc7df2+6:2400:x1869755157986048:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1783137990.414190:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b20e0912-b8b7-4542-a41b-c590a4cc7df2+6:2400:x1869755157986048:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137990.414196:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:3.0:1783137990.414205:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:3.0:1783137990.414210:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+13:2400:x1869755157985664:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1783137990.414247:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+13:2400:x1869755157985664:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 36us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137990.414253:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:3.0:1783137990.414263:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:3.0:1783137990.414269:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b20e0912-b8b7-4542-a41b-c590a4cc7df2+5:2400:x1869755157986176:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1783137990.414289:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b20e0912-b8b7-4542-a41b-c590a4cc7df2+5:2400:x1869755157986176:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 20us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137990.414303:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:3.0:1783137990.414351:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157985920 00000100:00100000:3.0:1783137990.414354:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157985920 00000100:00100000:3.0:1783137990.414382:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:3.0:1783137990.414388:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:2400:x1869755157985920:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1783137990.414415:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:2400:x1869755157985920:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137990.414420:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00080000:3.0:1783137990.414440:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137990.414445:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783137990.414446:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783137990.417136:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157985536 00000100:00100000:1.0:1783137990.417155:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157985536 00000100:00100000:1.0:1783137990.417233:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00100000:1.0:1783137990.417243:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:239553a0-fafa-47a5-8e48-0f5f76715990+13:2400:x1869755157985536:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783137990.417339:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:239553a0-fafa-47a5-8e48-0f5f76715990+13:2400:x1869755157985536:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 98us (3616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137990.417347:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 171 00010000:00010000:2.0:1783137990.777480:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783137991.034597:0:19499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b20e0912-b8b7-4542-a41b-c590a4cc7df2 00000020:00000080:3.0:1783137991.034607:0:19499:0:(genops.c:906:class_export_put()) final put ffff9e3e048fa800/b20e0912-b8b7-4542-a41b-c590a4cc7df2 00000020:00000080:1.0:1783137991.034703:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e048fa800/b20e0912-b8b7-4542-a41b-c590a4cc7df2 for lustre-OST0001 00000020:00000080:1.0:1783137991.034754:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f043b1800 for lustre-OST0001 00000001:00100000:0.0:1783137991.035727:0:18681:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b20e0912-b8b7-4542-a41b-c590a4cc7df2 00000020:00000080:0.0:1783137991.035734:0:18681:0:(genops.c:906:class_export_put()) final put ffff9e3e048f9800/b20e0912-b8b7-4542-a41b-c590a4cc7df2 00000001:00100000:0.0:1783137991.035760:0:18681:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 632e5dd9-edc0-4444-905b-03ec5dccf51c 00000020:00000080:0.0:1783137991.035762:0:18681:0:(genops.c:906:class_export_put()) final put ffff9e3e0341d800/632e5dd9-edc0-4444-905b-03ec5dccf51c 00000020:00000080:2.0:1783137991.035945:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e048f9800/b20e0912-b8b7-4542-a41b-c590a4cc7df2 for lustre-OST0000 00000020:00000080:2.0:1783137991.035989:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0341d800/632e5dd9-edc0-4444-905b-03ec5dccf51c for lustre-OST0000 00000020:00000080:2.0:1783137991.036004:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e048fe000 for lustre-OST0000 00000020:00000080:2.0:1783137991.036009:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e0341d000 for lustre-OST0000 00010000:00010000:0.0:1783137991.807278:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783137992.057596:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175895680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783137992.057677:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137992.057750:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175895680 00000100:00100000:1.0:1783137992.057758:0:18688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175895680 00000100:00100000:1.0:1783137992.057812:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783137992.057822:0:18688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175895680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783137992.057853:0:18688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783137992.057897:0:18688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175895680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137992.057904:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1783137992.058050:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137992.058088:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175895680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783137992.058303:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137992.058360:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175895808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137992.058394:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137992.058674:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3660:1869755175895936:0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.058711:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137992.058732:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175896448:0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.058756:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137992.058773:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869755175896960:0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.058795:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137992.058813:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783137992.058819:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175896064:0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.058840:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137992.058854:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175896576:0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.058889:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137992.058906:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869755175897088:0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.058950:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137992.058980:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175896448 00000100:00100000:0.0:1783137992.058985:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175896448 00000100:00100000:0.0:1783137992.059009:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175896064 00000100:00100000:0.0:1783137992.059011:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175896064 00000100:00100000:0.0:1783137992.059035:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783137992.059043:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175896448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.059086:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175896448:12345-0@lo:400:kworker.0 Request processed in 44us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137992.059093:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783137992.059107:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783137992.059113:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175896064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.059140:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175896064:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137992.059146:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783137992.059162:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175896960 00000100:00100000:0.0:1783137992.059165:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175896960 00000100:00100000:0.0:1783137992.059194:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175897088 00000100:00100000:0.0:1783137992.059197:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175897088 00000100:00100000:0.0:1783137992.059214:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783137992.059220:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869755175896960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.059261:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869755175896960:12345-0@lo:400:kworker.0 Request processed in 41us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137992.059268:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783137992.059280:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783137992.059294:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869755175897088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.059359:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869755175897088:12345-0@lo:400:kworker.0 Request processed in 66us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137992.059365:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783137992.059388:0:19078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175896576 00000100:00100000:0.0:1783137992.059391:0:19078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175896576 00000100:00100000:0.0:1783137992.059417:0:19078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783137992.059423:0:19078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0371fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175896576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.059452:0:19078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0371fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175896576:12345-0@lo:400:kworker.0 Request processed in 30us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137992.059458:0:19078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783137992.059488:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175896064:0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.059500:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175896576:0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.059509:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869755175897088:0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.059519:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175896448:0@lo:400:kworker.0 00010000:00080000:0.0:1783137992.059530:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f362e2300 x1869755175896960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783137992.059540:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869755175896960:0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.060536:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175896192:0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.060587:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137992.060621:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869755175896704:0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.060643:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137992.060674:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869755175897216:0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.060695:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137992.060716:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783137992.060723:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175896320:0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.060743:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137992.060774:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869755175896832:0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.060795:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137992.060822:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175896704 00000100:00100000:3.0:1783137992.060827:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175896704 00000100:00100000:3.0:1783137992.060854:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175897216 00000100:00100000:3.0:1783137992.060857:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175897216 00000100:00100000:3.0:1783137992.060870:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175896320 00000100:00100000:3.0:1783137992.060873:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175896320 00000100:00100000:3.0:1783137992.060885:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175896832 00000100:00100000:3.0:1783137992.060888:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175896832 00000100:00100000:3.0:1783137992.060904:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783137992.061074:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175896192 00000100:00100000:0.0:1783137992.061079:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175896192 00000100:00100000:0.0:1783137992.061112:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783137992.061119:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175896192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137992.061170:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175896192:12345-0@lo:400:kworker.0 Request processed in 52us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137992.061187:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783137992.061240:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869755175896704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.061276:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869755175896704:12345-0@lo:400:kworker.0 Request processed in 366us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137992.061283:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783137992.061309:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783137992.061340:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869755175897216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.061369:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869755175897216:12345-0@lo:400:kworker.0 Request processed in 31us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137992.061375:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783137992.061386:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783137992.061392:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175896320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.061433:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175896320:12345-0@lo:400:kworker.0 Request processed in 40us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137992.061439:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783137992.061452:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783137992.061458:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869755175896832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.061495:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869755175896832:12345-0@lo:400:kworker.0 Request processed in 36us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137992.061501:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783137992.062442:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175896320:0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.062457:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869755175896832:0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.062469:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175896192:0@lo:400:kworker.0 00000100:00100000:3.0:1783137992.062480:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869755175896704:0@lo:400:kworker.0 00010000:00080000:3.0:1783137992.062494:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f362e2d80 x1869755175897216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137992.062505:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869755175897216:0@lo:400:kworker.0 00000100:00100000:1.0:1783137992.062650:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175895936 00000100:00100000:1.0:1783137992.062670:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175895936 00000100:00100000:1.0:1783137992.062724:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783137992.062732:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+24:3660:x1869755175895936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137992.062795:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+24:3660:x1869755175895936:12345-0@lo:400:kworker.0 Request processed in 64us (4083us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137992.062802:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1783137992.062840:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783137992.062845:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783137992.062848:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783137992.062859:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175895808 00000100:00100000:1.0:1783137992.062862:0:18688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175895808 00000100:00100000:1.0:1783137992.062894:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783137992.062926:0:18688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175895808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783137992.062944:0:18688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783137992.062985:0:18688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175895808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (4590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137992.062991:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1783137992.063010:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783137992.063047:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175895808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783137992.063272:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3660:1869755175895936:0@lo:400:kworker.0 00010000:00010000:1.0:1783137992.826783:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137993.081700:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783137993.081725:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175897344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783137993.081798:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137993.081892:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175897344 00000100:00100000:0.0:1783137993.081900:0:18688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175897344 00000100:00100000:0.0:1783137993.081954:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783137993.081963:0:18688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175897344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137993.081993:0:18688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783137993.082065:0:18688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175897344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137993.082071:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783137993.082116:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175897344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783137993.082584:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175897472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783137993.082626:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137993.082748:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175897600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783137993.082779:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137993.082896:0:18688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175897600 00000100:00100000:0.0:1783137993.082901:0:18688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175897600 00000100:00100000:0.0:1783137993.082939:0:18688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783137993.082947:0:18688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175897600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783137993.082959:0:18688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783137993.082999:0:18688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175897600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137993.083006:0:18688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783137993.083060:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175897600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783137993.083390:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175897472 00000100:00100000:2.0:1783137993.083395:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175897472 00000100:00100000:2.0:1783137993.083430:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783137993.083437:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175897472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783137993.083461:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1783137993.083504:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175897472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137993.083511:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783137993.084359:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175897472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783137993.596610:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783137993.596641:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175897728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783137993.596718:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137993.596842:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175897728 00000100:00100000:0.0:1783137993.596850:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175897728 00000100:00100000:0.0:1783137993.596909:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783137993.596918:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175897728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783137993.596951:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783137993.597003:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175897728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137993.597034:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783137993.597233:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175897728:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783137993.850048:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137994.486816:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783137994.486904:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157986432 00000100:00100000:1.0:1783137994.486919:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157986432 00000100:00100000:1.0:1783137994.487033:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:1.0:1783137994.487046:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:632e5dd9-edc0-4444-905b-03ec5dccf51c+13:16374:x1869755157986432:12345-192.168.203.43@tcp:35:umount.0 00000001:00080000:1.0:1783137994.487296:0:17184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1783137994.487424:0:17184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:1.0:1783137994.487551:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:632e5dd9-edc0-4444-905b-03ec5dccf51c+16:16374:x1869755157986432:12345-192.168.203.43@tcp:35:umount.0 Request processed in 508us (750us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1783137994.487559:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000020:00080000:1.0:1783137994.487563:0:17184:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:2.0:1783137994.487807:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783137994.495225:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783137994.495394:0:19078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157986944 00000100:00100000:0.0:1783137994.495404:0:19078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157986944 00000100:00100000:0.0:1783137994.495481:0:19078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1783137994.495492:0:19078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:2399:x1869755157986944:12345-192.168.203.43@tcp:9:umount.0 00000020:00000080:0.0:1783137994.495530:0:19078:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c826 00000100:00080000:0.0:1783137994.495540:0:19078:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783137994.495595:0:19078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1783137994.495792:0:19078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:632e5dd9-edc0-4444-905b-03ec5dccf51c+2:2399:x1869755157986944:12345-192.168.203.43@tcp:9:umount.0 Request processed in 301us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137994.495800:0:19078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00080000:2.0:1783137994.495988:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783137994.499520:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137994.503489:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137994.503534:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137994.503580:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783137994.503680:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157986560 00000100:00100000:0.0:1783137994.503690:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157986560 00000100:00100000:0.0:1783137994.503739:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157986816 00000100:00100000:0.0:1783137994.503742:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157986816 00000100:00100000:0.0:1783137994.503756:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157986688 00000100:00100000:0.0:1783137994.503759:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157986688 00000100:00100000:0.0:1783137994.503777:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:0.0:1783137994.503788:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:239553a0-fafa-47a5-8e48-0f5f76715990+15:2403:x1869755157986560:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137994.503805:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137994.503826:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028b9a00/0x50a9699713c4c7fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a51b expref: 15 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137994.503844:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137994.503899:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:239553a0-fafa-47a5-8e48-0f5f76715990+14:2403:x1869755157986560:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 113us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137994.503906:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:0.0:1783137994.503935:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1783137994.503942:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:239553a0-fafa-47a5-8e48-0f5f76715990+13:2403:x1869755157986816:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137994.503950:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137994.503960:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f421de000/0x50a9699713c4c8c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a602 expref: 13 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137994.503970:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137994.503989:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:239553a0-fafa-47a5-8e48-0f5f76715990+12:2403:x1869755157986816:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 48us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137994.503996:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1783137994.504047:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:0.0:1783137994.504054:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36225500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:239553a0-fafa-47a5-8e48-0f5f76715990+11:2403:x1869755157986688:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783137994.504062:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783137994.504071:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028b8c00/0x50a9699713c4c803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a54c expref: 11 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137994.504079:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783137994.504097:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36225500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:239553a0-fafa-47a5-8e48-0f5f76715990+10:2403:x1869755157986688:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 44us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137994.504103:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:0.0:1783137994.527250:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137994.527455:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157987840 00000100:00100000:3.0:1783137994.527465:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157987840 00000100:00100000:3.0:1783137994.527529:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:3.0:1783137994.527539:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+16:2399:x1869755157987840:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:3.0:1783137994.527590:0:17182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c811 00000020:00010000:3.0:1783137994.527607:0:17182:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e3f36380000: total 0 00000100:00080000:3.0:1783137994.527611:0:17182:0:(import.c:65:import_set_state_nolock()) ffff9e3f36385000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783137994.527642:0:17182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:3.0:1783137994.527861:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:632e5dd9-edc0-4444-905b-03ec5dccf51c+15:2399:x1869755157987840:12345-192.168.203.43@tcp:39:umount.0 Request processed in 322us (620us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1783137994.527870:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000020:00010000:1.0:1783137994.527973:0:19710:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e3f36380000: total 0 00010000:00010000:1.0:1783137994.527978:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137994.528038:0:19710:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e3f36380000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1783137994.528084:0:19710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e3f199d8200) 00010000:00010000:1.0:1783137994.528088:0:19710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137994.528097:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f421dea00/0x50a9699713c4c8dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a609 expref: 14 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137994.528120:0:19710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e3e02542b00) 00010000:00010000:1.0:1783137994.528123:0:19710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783137994.528127:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f00031e00/0x50a9699713c4c9bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a648 expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137994.528143:0:19710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e3e02542a00) 00010000:00010000:1.0:1783137994.528145:0:19710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783137994.528149:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fea00/0x50a9699713c4ca6b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a687 expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137994.528162:0:19710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e3e02542a00) 00010000:00010000:1.0:1783137994.528164:0:19710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783137994.528168:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f00031c00/0x50a9699713c4ca3a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a672 expref: 11 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137994.528179:0:19710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e3e02542a00) 00010000:00010000:1.0:1783137994.528181:0:19710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783137994.528185:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffc00/0x50a9699713c4cb21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a6bf expref: 10 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137994.528213:0:19710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e3e02542f00) 00010000:00010000:1.0:1783137994.528216:0:19710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783137994.528220:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8800/0x50a9699713c4c8f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a610 expref: 9 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137994.528248:0:19710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3e02542400) 00010000:00010000:1.0:1783137994.528251:0:19710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137994.528255:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f0151ba00/0x50a9699713c4c937 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a61e expref: 8 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137994.528269:0:19710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e3e03624900) 00010000:00010000:1.0:1783137994.528272:0:19710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783137994.528275:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f341ffc00/0x50a9699713c4cac6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a69c expref: 7 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137994.528288:0:19710:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e3f36380000, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1783137994.528364:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137994.528366:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137994.528368:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783137994.546994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783137994.547105:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157987968 00000100:00100000:0.0:1783137994.547114:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157987968 00000100:00100000:0.0:1783137994.547183:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:0.0:1783137994.547193:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f36224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:632e5dd9-edc0-4444-905b-03ec5dccf51c+5:2399:x1869755157987968:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:0.0:1783137994.547230:0:20133:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c818 00000100:00080000:0.0:1783137994.547257:0:20133:0:(import.c:65:import_set_state_nolock()) ffff9e3f071b0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783137994.547290:0:20133:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1783137994.547546:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f36224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:632e5dd9-edc0-4444-905b-03ec5dccf51c+3:2399:x1869755157987968:12345-192.168.203.43@tcp:39:umount.0 Request processed in 354us (571us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783137994.547554:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00010000:00010000:1.0:1783137994.547748:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783137994.547870:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1783137994.809595:0:17214:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783137994.809604:0:17214:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783137994.809622:0:17214:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783137994.809630:0:17214:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1783137994.873595:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137995.531938:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783137995.531980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783137995.532027:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783137995.532058:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157988352 00000100:00100000:2.0:1783137995.532067:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157988352 00000100:00100000:2.0:1783137995.532131:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157988224 00000100:00100000:2.0:1783137995.532134:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157988224 00000100:00100000:2.0:1783137995.532157:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:2.0:1783137995.532167:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b20e0912-b8b7-4542-a41b-c590a4cc7df2+5:2402:x1869755157988352:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1783137995.532465:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b20e0912-b8b7-4542-a41b-c590a4cc7df2+5:2402:x1869755157988352:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137995.532475:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:2.0:1783137995.532495:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:2.0:1783137995.532502:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b20e0912-b8b7-4542-a41b-c590a4cc7df2+6:2402:x1869755157988224:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1783137995.532531:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b20e0912-b8b7-4542-a41b-c590a4cc7df2+6:2402:x1869755157988224:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 30us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137995.532538:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00080000:2.0:1783137995.532557:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783137995.532561:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783137995.532972:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157988096 00000100:00100000:3.0:1783137995.532978:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157988096 00000100:00100000:3.0:1783137995.533030:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 173 00000100:00100000:3.0:1783137995.533036:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:239553a0-fafa-47a5-8e48-0f5f76715990+10:2402:x1869755157988096:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1783137995.533079:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:239553a0-fafa-47a5-8e48-0f5f76715990+10:2402:x1869755157988096:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 43us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137995.533086:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 173 00010000:00010000:1.0:1783137995.900514:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137996.921861:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783137997.039741:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783137997.039801:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137997.039883:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157988480 00000100:00100000:3.0:1783137997.039893:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157988480 00000100:00100000:3.0:1783137997.040285:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157988608 00000100:00100000:3.0:1783137997.040290:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157988608 00000100:00100000:1.0:1783137997.040366:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1783137997.040379:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:239553a0-fafa-47a5-8e48-0f5f76715990+11:2400:x1869755157988480:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137997.040394:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137997.040413:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f341ff000/0x50a9699713c4c83b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a58b expref: 11 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137997.040431:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137997.040488:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:239553a0-fafa-47a5-8e48-0f5f76715990+10:2400:x1869755157988480:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 112us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137997.040510:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1783137997.040530:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1783137997.040536:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:239553a0-fafa-47a5-8e48-0f5f76715990+9:2400:x1869755157988608:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783137997.040543:0:17165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783137997.040552:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f0151b800/0x50a9699713c4c8b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a5fb expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137997.040561:0:17165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783137997.040580:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:239553a0-fafa-47a5-8e48-0f5f76715990+8:2400:x1869755157988608:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 45us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137997.040586:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:0.0:1783137997.048356:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783137997.048460:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157988736 00000100:00100000:2.0:1783137997.048471:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157988736 00000100:00100000:2.0:1783137997.048530:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1783137997.048539:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:239553a0-fafa-47a5-8e48-0f5f76715990+8:2403:x1869755157988736:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783137997.048570:0:17167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783137997.048588:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f421de200/0x50a9699713c4c842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a5bc expref: 8 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137997.048604:0:17167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783137997.048662:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:239553a0-fafa-47a5-8e48-0f5f76715990+7:2403:x1869755157988736:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 124us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783137997.048671:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1783137997.057456:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783137997.057601:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157988992 00000100:00100000:0.0:1783137997.057611:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157988992 00000100:00100000:0.0:1783137997.057686:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:0.0:1783137997.057696:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b20e0912-b8b7-4542-a41b-c590a4cc7df2+6:2399:x1869755157988992:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:0.0:1783137997.057738:0:17180:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c850 00000020:00010000:0.0:1783137997.057747:0:17180:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e3e04139800: total 0 00000100:00080000:0.0:1783137997.057751:0:17180:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783137997.057785:0:17180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1783137997.057951:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b20e0912-b8b7-4542-a41b-c590a4cc7df2+5:2399:x1869755157988992:12345-192.168.203.43@tcp:39:umount.0 Request processed in 256us (505us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1783137997.057959:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000020:00010000:1.0:1783137997.058226:0:17168:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e3e04139800: total 0 00010000:00010000:1.0:1783137997.058275:0:17168:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e3e04139800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783137997.058307:0:17168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3e02542400) 00010000:00010000:1.0:1783137997.058354:0:17168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783137997.058364:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f0151bc00/0x50a9699713c4c945 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a625 expref: 4 pid: 17180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137997.058390:0:17168:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e3e04139800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783137997.058401:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137997.058403:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783137997.058405:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783137997.058894:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783137997.070731:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783137997.070825:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157989120 00000100:00100000:2.0:1783137997.070843:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157989120 00000100:00100000:2.0:1783137997.070926:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:2.0:1783137997.070937:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b20e0912-b8b7-4542-a41b-c590a4cc7df2+5:2399:x1869755157989120:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:2.0:1783137997.070978:0:20133:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c857 00000100:00080000:2.0:1783137997.070996:0:20133:0:(import.c:65:import_set_state_nolock()) ffff9e3f3f4ba000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1783137997.071274:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:2.0:1783137997.073388:0:20133:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1783137997.073561:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b20e0912-b8b7-4542-a41b-c590a4cc7df2+3:2399:x1869755157989120:12345-192.168.203.43@tcp:39:umount.0 Request processed in 2622us (2835us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783137997.073574:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00010000:00010000:3.0:1783137997.074892:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137997.152281:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783137997.157793:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157989376 00000100:00100000:3.0:1783137997.157809:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157989376 00000100:00100000:3.0:1783137997.158020:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:3.0:1783137997.158033:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:239553a0-fafa-47a5-8e48-0f5f76715990+7:2399:x1869755157989376:12345-192.168.203.43@tcp:251:umount.0 00000020:00000080:3.0:1783137997.158085:0:17175:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c7ee 00000020:00010000:3.0:1783137997.158106:0:17175:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e3e03418000: total 0 00000100:00080000:3.0:1783137997.158124:0:17175:0:(import.c:65:import_set_state_nolock()) ffff9e3e03418800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783137997.158213:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:239553a0-fafa-47a5-8e48-0f5f76715990+3:2399:x1869755157989376:12345-192.168.203.43@tcp:251:umount.0 Request processed in 183us (5941us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137997.158222:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 174 00000020:00010000:2.0:1783137997.158253:0:17169:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e3e03418000: total 0 00010000:00010000:2.0:1783137997.158303:0:17169:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e3e03418000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783137997.158373:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4c7f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a514 expref: 2 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137997.158391:0:17169:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e3e03418000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1783137997.158401:0:17169:0:(genops.c:906:class_export_put()) final put ffff9e3e03418000/239553a0-fafa-47a5-8e48-0f5f76715990 00010000:00010000:2.0:1783137997.158413:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137997.158415:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137997.158416:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783137997.158435:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e03418000/239553a0-fafa-47a5-8e48-0f5f76715990 for MGS 00000020:00000080:0.0:1783137997.158459:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e03418800 for MGS 00000100:00100000:3.0:1783137997.177531:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175898240:0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.177599:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137997.177653:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175898752:0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.177678:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137997.177703:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869755175899264:0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.177725:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137997.177742:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1783137997.177747:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3658:1869755175897856:0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.177777:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137997.177798:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175898368:0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.177820:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137997.177843:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869755175898880:0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.177862:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175899264 00000100:00100000:3.0:1783137997.177863:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137997.177875:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869755175899392:0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.177886:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175899264 00000100:00100000:3.0:1783137997.177893:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137997.177928:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175898368 00000100:00100000:3.0:1783137997.177929:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175898240 00000100:00100000:3.0:1783137997.177932:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175898240 00000100:00100000:2.0:1783137997.177932:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175898368 00000100:00100000:2.0:1783137997.177944:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175898880 00000100:00100000:2.0:1783137997.177946:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175898880 00000100:00100000:2.0:1783137997.177955:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175899392 00000100:00100000:3.0:1783137997.177956:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175898752 00000100:00100000:2.0:1783137997.177957:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175899392 00000100:00100000:3.0:1783137997.177958:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175898752 00000100:00100000:2.0:1783137997.177971:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783137997.177972:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783137997.177979:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0427d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175898240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.177980:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869755175899264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.178038:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0427d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175898240:12345-0@lo:400:kworker.0 Request processed in 59us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137997.178059:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783137997.178075:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783137997.178081:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0427ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175898752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.178113:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0427ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175898752:12345-0@lo:400:kworker.0 Request processed in 32us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137997.178119:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783137997.178136:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175897856 00000100:00100000:3.0:1783137997.178139:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175897856 00000100:00100000:3.0:1783137997.178159:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783137997.178165:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+24:3658:x1869755175897856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.178191:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+24:3658:x1869755175897856:12345-0@lo:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137997.178197:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783137997.178227:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783137997.178230:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869755175899264:12345-0@lo:400:kworker.0 Request processed in 252us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137997.178233:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175898368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.178237:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783137997.178248:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783137997.178254:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869755175898880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.178257:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175898368:12345-0@lo:400:kworker.0 Request processed in 25us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137997.178262:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783137997.178273:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783137997.178276:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869755175898880:12345-0@lo:400:kworker.0 Request processed in 23us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137997.178278:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869755175899392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.178282:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1783137997.178295:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783137997.178299:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1869755175899392:12345-0@lo:400:kworker.0 Request processed in 22us (405us total) trans 0 rc 0/0 00000100:00080000:2.0:1783137997.178300:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783137997.178302:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783137997.178305:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783137997.178367:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3658:1869755175897856:0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.178380:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175898368:0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.178388:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869755175898880:0@lo:400:kworker.0 00010000:00080000:2.0:1783137997.178397:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e03b03480 x1869755175899392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783137997.178414:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869755175899392:0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.178425:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175898752:0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.178434:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869755175899264:0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.178442:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175898240:0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.181599:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175897984:0@lo:400:kworker.0 00000100:00100000:0.0:1783137997.181630:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175898112:0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.181666:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137997.181666:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137997.181699:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175898496:0@lo:400:kworker.0 00000100:00100000:0.0:1783137997.181699:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175898624:0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.181719:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137997.181719:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137997.181734:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175899008:0@lo:400:kworker.0 00000100:00100000:0.0:1783137997.181734:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869755175899136:0@lo:400:kworker.0 00000100:00100000:2.0:1783137997.181754:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137997.181802:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175897984 00000100:00100000:1.0:1783137997.181811:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175897984 00000100:00100000:1.0:1783137997.181851:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175898496 00000100:00100000:1.0:1783137997.181854:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175898496 00000100:00100000:1.0:1783137997.181867:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783137997.183250:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175899520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783137997.183294:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137997.183412:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175897984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137997.183473:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175897984:12345-0@lo:400:kworker.0 Request processed in 65us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137997.184012:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175899008 00000100:00100000:0.0:1783137997.184020:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175899008 00000100:00100000:0.0:1783137997.184072:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783137997.184079:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175899008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137997.184557:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175899008:12345-0@lo:400:kworker.0 Request processed in 476us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137997.184566:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783137997.184614:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175898112 00000100:00100000:0.0:1783137997.184618:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175898112 00000100:00100000:0.0:1783137997.184643:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175898624 00000100:00100000:0.0:1783137997.184646:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175898624 00000100:00100000:0.0:1783137997.184659:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783137997.184664:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175898112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137997.184697:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175898112:12345-0@lo:400:kworker.0 Request processed in 33us (3032us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137997.184703:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783137997.184713:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783137997.184719:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175898624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783137997.184744:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175898624:12345-0@lo:400:kworker.0 Request processed in 25us (3025us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137997.184749:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783137997.184819:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175897984:0@lo:400:kworker.0 00000100:00100000:0.0:1783137997.184832:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175899008:0@lo:400:kworker.0 00000100:00080000:0.0:1783137997.184905:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783137997.187158:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137997.187177:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175899648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783137997.187249:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137997.187288:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175899520 00000100:00100000:3.0:1783137997.187296:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175899520 00000100:00100000:3.0:1783137997.187350:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175899648 00000100:00100000:3.0:1783137997.187353:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175899648 00000100:00100000:3.0:1783137997.187368:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783137997.187377:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175899520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783137997.187405:0:18689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783137997.187447:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175899520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (4152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137997.187454:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783137997.187470:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783137997.187475:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175899648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783137997.187484:0:18689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783137997.187506:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175899648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137997.187512:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783137997.188360:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175899648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783137997.188386:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175899520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783137997.188460:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137997.188502:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175898112:0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.188513:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175898624:0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.188551:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175899136 00000100:00100000:3.0:1783137997.188557:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175899136 00000100:00100000:3.0:1783137997.188600:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783137997.188618:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869755175899136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783137997.188666:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1869755175899136:12345-0@lo:400:kworker.0 Request processed in 49us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137997.188672:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1783137997.188701:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e03b02300 x1869755175899136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783137997.188711:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869755175899136:0@lo:400:kworker.0 00000100:00080000:0.0:1783137997.189030:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783137997.189035:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783137997.189639:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783137997.189667:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783137997.189678:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175898496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783137997.189749:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175898496:12345-0@lo:400:kworker.0 Request processed in 75us (8028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783137997.189756:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783137997.189850:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175898496:0@lo:400:kworker.0 00010000:00010000:3.0:1783137997.948918:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137998.206259:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175899776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783137998.206448:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137998.206491:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783137998.206498:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175899904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783137998.206520:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137998.206552:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175899776 00000100:00100000:0.0:1783137998.206559:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175899776 00000100:00100000:0.0:1783137998.206597:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175899904 00000100:00100000:0.0:1783137998.206601:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175899904 00000100:00100000:0.0:1783137998.207755:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783137998.207777:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175899776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783137998.207816:0:18689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783137998.207905:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175899776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137998.207911:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783137998.207931:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783137998.207937:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175899904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783137998.207947:0:18689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783137998.207969:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175899904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137998.207975:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783137998.208430:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175900032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783137998.208471:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137998.208531:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175900032 00000100:00100000:0.0:1783137998.208537:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175900032 00000100:00100000:0.0:1783137998.208568:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783137998.208575:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175900032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783137998.208601:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1783137998.209719:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175900032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 398us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137998.209734:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783137998.209813:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175900032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783137998.210775:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175899904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783137998.210803:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175899776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783137998.714283:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175900160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783137998.714379:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783137998.717340:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175900160 00000100:00100000:0.0:1783137998.717356:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175900160 00000100:00100000:0.0:1783137998.717412:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783137998.717425:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175900160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783137998.717464:0:17185:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783137998.717547:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175900160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (3167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783137998.717555:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783137998.717593:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175900160:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783137998.971473:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783137999.128864:0:20749:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783137999.147457:0:20749:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1783137999.147512:0:20749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a600/0x50a9699713c4c3b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c3b8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137999.147527:0:20749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a600/0x50a9699713c4c3b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c3b8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137999.147534:0:20749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a600/0x50a9699713c4c3b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c3b8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137999.147542:0:20749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a600/0x50a9699713c4c3b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c3b8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783137999.147569:0:20749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783137999.147575:0:20749:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783137999.147603:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783137999.147608:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783137999.147614:0:20749:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783137999.147653:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9e3f36023800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783137999.147730:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137999.147737:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a600/0x50a9699713c4c3b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c3b8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.147746:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f0151a600 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:2.0:1783137999.147756:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a600/0x50a9699713c4c3b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c3b8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.147765:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a600/0x50a9699713c4c3b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c3b8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137999.147773:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a600/0x50a9699713c4c3b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c3b8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137999.147779:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783137999.147781:0:17169:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783137999.147784:0:17169:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783137999.147808:0:17169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a600/0x50a9699713c4c3b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c3b8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.147814:0:17169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783137999.147864:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1783137999.150499:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a600/0x50a9699713c4c3b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c3b8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.150517:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a600/0x50a9699713c4c3b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c3b8 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.150539:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137999.150541:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137999.150545:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137999.150668:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869755175900288:0@lo:39:umount.0 00000100:00100000:0.0:1783137999.150739:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137999.150825:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175900288 00000100:00100000:3.0:1783137999.150833:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175900288 00000100:00100000:3.0:1783137999.150888:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783137999.150898:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869755175900288:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783137999.150927:0:20133:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c3e2 00000100:00080000:3.0:1783137999.150934:0:20133:0:(import.c:65:import_set_state_nolock()) ffff9e3f05411800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783137999.151008:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3657:x1869755175900288:12345-0@lo:39:umount.0 Request processed in 111us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137999.151015:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1783137999.151025:0:20133:0:(genops.c:906:class_export_put()) final put ffff9e3f05414000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1783137999.151091:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f36023800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783137999.151110:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869755175900288:0@lo:39:umount.0 00000100:00080000:3.0:1783137999.151158:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783137999.151161:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783137999.151166:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783137999.152113:0:20749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8600/0x50a9699713c4c302 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c309 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152128:0:20749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8600/0x50a9699713c4c302 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c309 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152142:0:20749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8600/0x50a9699713c4c302 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c309 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152149:0:20749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8600/0x50a9699713c4c302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c309 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152172:0:20749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783137999.152179:0:20749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f36321200/0x50a9699713c4c70e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c715 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152186:0:20749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f36321200/0x50a9699713c4c70e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c715 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152193:0:20749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f36321200/0x50a9699713c4c70e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c715 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152201:0:20749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3f36321200/0x50a9699713c4c70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c715 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152211:0:20749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783137999.152217:0:20749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4c8ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c8b2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152223:0:20749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4c8ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c8b2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152229:0:20749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4c8ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c8b2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152244:0:20749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4c8ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c8b2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152252:0:20749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783137999.152257:0:20749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9000/0x50a9699713c4c2f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c2fb expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152264:0:20749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9000/0x50a9699713c4c2f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c2fb expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152271:0:20749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9000/0x50a9699713c4c2f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c2fb expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152277:0:20749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9000/0x50a9699713c4c2f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c2fb expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.152285:0:20749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1783137999.152289:0:20749:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1783137999.152351:0:20749:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783137999.152355:0:20749:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1783137999.152359:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783137999.152364:0:20749:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:3.0:1783137999.152370:0:20749:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e3e039bb000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783137999.152376:0:20749:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e3f3f929000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783137999.152381:0:20749:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e3f071b2800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783137999.152386:0:20749:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e3e035d4000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783137999.152391:0:20749:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9e3e04139800 b20e0912-b8b7-4542-a41b-c590a4cc7df2 192.168.203.43@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1783137999.152402:0:20749:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9e3f36380000 632e5dd9-edc0-4444-905b-03ec5dccf51c 192.168.203.43@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1783137999.152406:0:20749:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e3f3624b380) has exports, disconnecting them 00000020:00080000:3.0:1783137999.152410:0:20749:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e3e039bb000), last request at 1783137997 00000020:00000080:3.0:1783137999.152416:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c6dd 00000100:00080000:3.0:1783137999.152431:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9e3e039be800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783137999.152473:0:20749:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3e039bb000): rc 0 00000020:00000080:3.0:1783137999.152476:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3e039bb000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783137999.152482:0:20749:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e3f3f929000), last request at 1783137997 00000020:00000080:3.0:1783137999.152485:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c57f 00000100:00080000:3.0:1783137999.152489:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9e3f3f92e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783137999.152495:0:20749:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3f3f929000): rc 0 00000020:00000080:3.0:1783137999.152497:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f3f929000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1783137999.152501:0:20749:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e3f071b2800), last request at 1783137916 00000020:00000080:3.0:1783137999.152503:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c4d0 00000100:00080000:3.0:1783137999.152506:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9e3f071b7000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783137999.152511:0:20749:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3f071b2800): rc 0 00000020:00000080:3.0:1783137999.152513:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f071b2800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1783137999.152516:0:20749:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e3e035d4000), last request at 1783137916 00000020:00000080:3.0:1783137999.152519:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c467 00000100:00080000:3.0:1783137999.152522:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9e3f05414800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783137999.152528:0:20749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:3.0:1783137999.152591:0:20749:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3e035d4000): rc 0 00000004:00000080:3.0:1783137999.152597:0:20749:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbaa8c7963ae0 00000100:00080000:3.0:1783137999.152613:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783137999.152616:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783137999.153463:0:20749:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783137999.153488:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9e3f341f1800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1783137999.153680:0:19710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783137999.153688:0:19710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8600/0x50a9699713c4c302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c309 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137999.153699:0:19710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8600 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:0.0:1783137999.153709:0:19710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8600/0x50a9699713c4c302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c309 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137999.153719:0:19710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8600/0x50a9699713c4c302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c309 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783137999.153727:0:19710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8600/0x50a9699713c4c302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c309 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783137999.153733:0:19710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783137999.153736:0:19710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1783137999.153739:0:19710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1783137999.153766:0:19710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8600/0x50a9699713c4c302 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c309 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137999.153774:0:19710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137999.153835:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783137999.153841:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f36321200/0x50a9699713c4c70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c715 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.153849:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f36321200 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:2.0:1783137999.153852:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f36321200/0x50a9699713c4c70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c715 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.153866:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f36321200/0x50a9699713c4c70e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c715 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137999.153874:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f36321200/0x50a9699713c4c70e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c715 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137999.153880:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783137999.153882:0:17168:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783137999.153884:0:17168:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783137999.153898:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f36321200/0x50a9699713c4c70e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c715 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.153904:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137999.153929:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f36321200/0x50a9699713c4c70e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c715 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.153937:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f36321200/0x50a9699713c4c70e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c715 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.153952:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783137999.153955:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4c8ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c8b2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.153962:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f341ff800 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:2.0:1783137999.153965:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4c8ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c8b2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.153982:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4c8ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c8b2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137999.154000:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4c8ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c8b2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137999.154005:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783137999.154007:0:17168:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783137999.154010:0:17168:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783137999.154023:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4c8ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c8b2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.154028:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783137999.154034:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4c8ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c8b2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.154041:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4c8ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c8b2 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.154049:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783137999.154052:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9000/0x50a9699713c4c2f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c2fb expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.154057:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9000 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:2.0:1783137999.154060:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9000/0x50a9699713c4c2f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c2fb expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.154066:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9000/0x50a9699713c4c2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c2fb expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783137999.154072:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9000/0x50a9699713c4c2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c2fb expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783137999.154088:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783137999.154090:0:17168:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783137999.154092:0:17168:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783137999.154105:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9000/0x50a9699713c4c2f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c2fb expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.154112:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783137999.154202:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3659:1869755175900672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137999.154264:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137999.154336:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3659:1869755175900416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137999.154357:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137999.154374:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783137999.154677:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3660:1869755175900800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137999.154705:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3659:1869755175901056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137999.154713:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137999.154743:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137999.154746:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783137999.154755:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3660:1869755175900928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137999.154782:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137999.154791:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175900672 00000100:00100000:3.0:1783137999.154806:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175900416 00000100:00100000:3.0:1783137999.154812:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175900416 00000100:00100000:3.0:1783137999.154845:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175900800 00000100:00100000:3.0:1783137999.154848:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175900800 00000100:00100000:3.0:1783137999.154861:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175901056 00000100:00100000:3.0:1783137999.154863:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175901056 00000100:00100000:3.0:1783137999.154873:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175900928 00000100:00100000:3.0:1783137999.154875:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175900928 00000100:00100000:3.0:1783137999.154890:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783137999.154898:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+27:3659:x1869755175900416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137999.154910:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137999.154924:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028b9600/0x50a9699713c4c3b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c3b1 expref: 27 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.154939:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137999.154982:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+26:3659:x1869755175900416:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137999.154991:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783137999.155008:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783137999.155014:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+25:3660:x1869755175900800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137999.155022:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137999.155030:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f341ff400/0x50a9699713c4c715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c70e expref: 25 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.155049:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137999.155076:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+24:3660:x1869755175900800:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137999.155082:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783137999.155094:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783137999.155100:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+23:3659:x1869755175901056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137999.155108:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137999.155117:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f0151b600/0x50a9699713c4c2fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c2f4 expref: 23 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.155127:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137999.155146:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+22:3659:x1869755175901056:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137999.155152:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783137999.155163:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137999.155169:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+21:3660:x1869755175900928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137999.155176:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783137999.155294:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175900672 00000100:00100000:1.0:1783137999.155785:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3659:1869755175901056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783137999.156231:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3659:1869755175900416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783137999.156443:0:19710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8600/0x50a9699713c4c302 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c309 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137999.156454:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8600/0x50a9699713c4c302 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c309 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783137999.156471:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137999.156473:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783137999.156475:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783137999.156490:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175900544:0@lo:39:umount.0 00000100:00100000:0.0:1783137999.156534:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783137999.156606:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175900544 00000100:00100000:1.0:1783137999.156611:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175900544 00000100:00100000:1.0:1783137999.156654:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783137999.156662:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1869755175900544:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783137999.156690:0:17185:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c4fa 00000100:00080000:1.0:1783137999.156698:0:17185:0:(import.c:65:import_set_state_nolock()) ffff9e3f34217800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783137999.156715:0:17185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:0.0:1783137999.157417:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137999.157486:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9000/0x50a9699713c4c2f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c2fb expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.157498:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9000/0x50a9699713c4c2f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c2fb expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783137999.157514:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137999.157516:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783137999.157518:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783137999.157531:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f05414000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783137999.157572:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e039bb000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783137999.157611:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3f929000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1783137999.157612:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3657:x1869755175900544:12345-0@lo:39:umount.0 Request processed in 947us (1074us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1783137999.157623:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000020:00000080:2.0:1783137999.157640:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f071b2800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783137999.157664:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f05411800 for lustre-MDT0000 00000020:00000080:2.0:1783137999.157669:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e039be800 for lustre-MDT0000 00000020:00000080:2.0:1783137999.157672:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f3f92e000 for lustre-MDT0000 00000020:00000080:2.0:1783137999.157676:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f071b7000 for lustre-MDT0000 00010000:00010000:2.0:1783137999.157687:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783137999.157828:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f341f1800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783137999.157836:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175900544:0@lo:39:umount.0 00010000:00010000:3.0:1783137999.158091:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f421dec00/0x50a9699713c4c8b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c8ab expref: 22 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.158105:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783137999.158142:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+21:3660:x1869755175900928:12345-0@lo:103:ldlm_bl.0 Request processed in 2971us (3358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137999.158151:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783137999.158169:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137999.158306:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+20:3659:x1869755175900672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783137999.158399:0:17166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783137999.158410:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f0151ac00/0x50a9699713c4c309 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c302 expref: 20 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783137999.158419:0:17166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1783137999.158501:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783137999.158505:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1783137999.158858:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783137999.158940:0:20749:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783137999.158959:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9e3f05417000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783137999.159483:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783137999.159487:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1783137999.159502:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783137999.159641:0:20749:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783137999.159654:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9e3f34213800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783137999.159699:0:20749:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e3f3624b380) has no exports 00000100:00100000:3.0:1783137999.159789:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4+19:3659:x1869755175900672:12345-0@lo:103:ldlm_bl.0 Request processed in 1610us (5522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137999.159799:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783137999.159877:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3660:1869755175900928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783137999.159887:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3660:1869755175900800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783137999.160390:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175901184:0@lo:9:umount.0 00000100:00100000:2.0:1783137999.160441:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783137999.160471:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175901312:0@lo:9:umount.0 00000100:00100000:2.0:1783137999.160505:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783137999.160598:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175901184 00000100:00100000:3.0:1783137999.160604:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175901184 00000100:00100000:3.0:1783137999.160648:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175901312 00000100:00100000:3.0:1783137999.160652:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175901312 00000100:00100000:3.0:1783137999.160671:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783137999.160680:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1869755175901184:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783137999.160702:0:18687:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c5c5 00000100:00080000:3.0:1783137999.160710:0:18687:0:(import.c:65:import_set_state_nolock()) ffff9e3f3f92c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783137999.160750:0:18687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1783137999.160874:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3657:x1869755175901184:12345-0@lo:9:umount.0 Request processed in 195us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137999.160882:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783137999.160895:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783137999.160901:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1869755175901312:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783137999.160913:0:18687:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c71c 00000100:00080000:3.0:1783137999.160918:0:18687:0:(import.c:65:import_set_state_nolock()) ffff9e3e039b8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783137999.160943:0:18687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1783137999.161025:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3657:x1869755175901312:12345-0@lo:9:umount.0 Request processed in 124us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783137999.161031:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1783137999.161088:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783137999.161122:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f05417000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783137999.161128:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783137999.161130:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783137999.161133:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175901184:0@lo:9:umount.0 00000100:00080000:2.0:1783137999.161143:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f34213800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783137999.161146:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783137999.161147:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783137999.161150:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175901312:0@lo:9:umount.0 00000100:00080000:3.0:1783137999.161775:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783137999.161780:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783137999.162122:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3659:1869755175900672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783137999.162149:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783137999.170595:0:20749:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e3f3624b380) has no exports 00000020:00000080:1.0:1783137999.239137:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c34f 00000020:00000080:1.0:1783137999.239154:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f341f5800/lustre-QMT0000_UUID 00000020:01000000:1.0:1783137999.239238:0:20749:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783137999.240415:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783137999.240430:0:20749:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783137999.240435:0:20749:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e3e02713380) has no exports 00000020:00000080:0.0:1783137999.241403:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c348 00000020:00000080:0.0:1783137999.241413:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f36128000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783137999.243486:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f341f5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783137999.245405:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783137999.245421:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783137999.245427:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f1277e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1783137999.245431:0:20749:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f1277e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783137999.245442:0:20749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1783137999.245697:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f36128000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000040:00080000:3.0:1783137999.482148:0:17933:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783137999.993478:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783138000.256810:0:17912:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783138000.256826:0:17912:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1783138000.256831:0:17912:0:(genops.c:906:class_export_put()) final put ffff9e3f360a0800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783138000.256910:0:17912:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b20e0912-b8b7-4542-a41b-c590a4cc7df2 00000001:00080000:2.0:1783138000.256916:0:17912:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1783138000.256919:0:17912:0:(genops.c:906:class_export_put()) final put ffff9e3e0413f800/b20e0912-b8b7-4542-a41b-c590a4cc7df2 00000001:00100000:1.0:1783138000.257729:0:19499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783138000.257736:0:19499:0:(genops.c:906:class_export_put()) final put ffff9e3e039be000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783138000.266500:0:17160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783138000.266510:0:17160:0:(genops.c:906:class_export_put()) final put ffff9e3e035d4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783138000.266601:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f360a0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1783138000.266666:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f34217800 for lustre-MDT0001 00000001:00100000:2.0:1783138000.276403:0:17912:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 632e5dd9-edc0-4444-905b-03ec5dccf51c 00000001:00080000:2.0:1783138000.276419:0:17912:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1783138000.276425:0:17912:0:(genops.c:906:class_export_put()) final put ffff9e3f3f92b000/632e5dd9-edc0-4444-905b-03ec5dccf51c 00000020:00000080:3.0:1783138000.276980:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0413f800/b20e0912-b8b7-4542-a41b-c590a4cc7df2 for lustre-MDT0001 00000020:00000080:3.0:1783138000.277035:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3f92b000/632e5dd9-edc0-4444-905b-03ec5dccf51c for lustre-MDT0001 00000020:00000080:3.0:1783138000.277057:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f3f4ba000 for lustre-MDT0001 00000020:00000080:3.0:1783138000.277060:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f071b0000 for lustre-MDT0001 00000001:00100000:1.0:1783138000.288424:0:19499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 632e5dd9-edc0-4444-905b-03ec5dccf51c 00000020:00000080:1.0:1783138000.288433:0:19499:0:(genops.c:906:class_export_put()) final put ffff9e3e03419000/632e5dd9-edc0-4444-905b-03ec5dccf51c 00000020:00000080:2.0:1783138000.291147:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e039be000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783138000.291230:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e03419000/632e5dd9-edc0-4444-905b-03ec5dccf51c for lustre-OST0001 00000020:00000080:2.0:1783138000.291252:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e039b8800 for lustre-OST0001 00000020:00000080:2.0:1783138000.291257:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e0341f000 for lustre-OST0001 00000001:00100000:0.0:1783138000.291710:0:17160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b20e0912-b8b7-4542-a41b-c590a4cc7df2 00000001:00080000:0.0:1783138000.291720:0:17160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1783138000.291724:0:17160:0:(genops.c:906:class_export_put()) final put ffff9e3e04139800/b20e0912-b8b7-4542-a41b-c590a4cc7df2 00000001:00100000:0.0:1783138000.291730:0:17160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 632e5dd9-edc0-4444-905b-03ec5dccf51c 00000001:00080000:0.0:1783138000.291734:0:17160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1783138000.291740:0:17160:0:(genops.c:906:class_export_put()) final put ffff9e3f36380000/632e5dd9-edc0-4444-905b-03ec5dccf51c 00000020:00000080:3.0:1783138000.291795:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e035d4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783138000.291835:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e04139800/b20e0912-b8b7-4542-a41b-c590a4cc7df2 for lustre-MDT0000 00000020:00000080:3.0:1783138000.291867:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f36380000/632e5dd9-edc0-4444-905b-03ec5dccf51c for lustre-MDT0000 00000020:00000080:3.0:1783138000.291900:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f05414800 for lustre-MDT0000 00000020:00000080:3.0:1783138000.291904:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e0413f000 for lustre-MDT0000 00000020:00000080:3.0:1783138000.291907:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f36385000 for lustre-MDT0000 00010000:00010000:2.0:1783138001.017530:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783138001.273477:0:20749:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e3f3e2a3060 - data ffff9e3f1fc90948/ffff9e3f35f7f400 00000020:01000000:0.0:1783138001.273631:0:20749:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e3e02887300 - data ffff9e3f04fa8af8/ffff9e3f37d41800 00000001:00000004:0.0:1783138001.288829:0:20749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1783138001.334444:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783138001.334452:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783138001.334467:0:20749:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e3f2f8c4380 x1869755175900544/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783138009 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138001.334519:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783138001.335582:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783138001.335587:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1783138001.335639:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783138001.335642:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783138001.337370:0:17204:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783138001.337377:0:17204:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1783138001.337387:0:17204:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1783138001.338041:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783138001.338046:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1783138001.338162:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783138001.338164:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783138001.340254:0:17206:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783138001.340261:0:17206:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1783138001.340271:0:17206:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1783138001.341523:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c317 00000020:00000080:0.0:1783138001.341533:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f3e270000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783138001.346497:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c32c 00000020:00000080:0.0:1783138001.346512:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f3e276000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783138001.346895:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3e270000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783138001.347003:0:20749:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1783138001.347019:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138001.347027:0:20749:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783138001.347031:0:20749:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e3f3624cd40) has no exports 00000004:01000000:0.0:1783138001.347207:0:20749:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783138001.347215:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c38e 00000020:00000080:0.0:1783138001.347220:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f34213000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783138001.347224:0:20749:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783138001.347228:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138001.347232:0:20749:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783138001.347234:0:20749:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9e3e03910000) has no exports 00000020:00000080:0.0:1783138001.347238:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c387 00000020:00000080:0.0:1783138001.347242:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f34212800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1783138001.347908:0:20749:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783138001.347914:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783138001.347918:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1783138001.347924:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783138001.347926:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783138001.347968:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138001.347974:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783138001.347981:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c379 00000020:00000080:0.0:1783138001.347987:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f34214000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783138001.347992:0:20749:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783138001.347996:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138001.347999:0:20749:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783138001.348001:0:20749:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9e3f36248000) has no exports 00000020:00000080:0.0:1783138001.348006:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c372 00000020:00000080:0.0:1783138001.348008:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f3e275000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783138001.348416:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3e276000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1783138001.348426:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f34213000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783138001.348431:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f34212800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783138001.348436:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f34213800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783138001.348441:0:8:0:(genops.c:906:class_export_put()) final put ffff9e3f34211000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783138001.348443:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f34211000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783138001.348448:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783138001.348523:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f34214000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783138001.348528:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3e275000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783138001.348671:0:20749:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783138001.348675:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783138001.348914:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1783138001.348921:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783138001.348923:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783138001.349015:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138001.349021:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1783138001.349035:0:20749:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783138001.349040:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c364 00000020:00000080:0.0:1783138001.349046:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f341f0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783138001.349392:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f05417000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783138001.349398:0:8:0:(genops.c:906:class_export_put()) final put ffff9e3f341f4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783138001.349401:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f341f4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783138001.349405:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783138001.349524:0:20749:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1783138001.349528:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138001.349532:0:20749:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783138001.349536:0:20749:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9e3e039119c0) has no exports 00000020:00000080:0.0:1783138001.349541:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c35d 00000020:00000080:0.0:1783138001.349545:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f341f2000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783138001.349768:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f341f0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783138001.349775:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f341f2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783138001.385442:0:20749:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783138001.385452:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783138001.385456:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783138001.385464:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783138001.385512:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138001.385524:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783138001.385552:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138001.385556:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783138001.385562:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f3e276800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783138001.385566:0:20749:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3e276800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783138001.385581:0:20749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783138001.385681:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c333 00000020:00000080:2.0:1783138001.385688:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f3e270800/lustre-MDD0000_UUID 00000020:01000000:2.0:1783138001.385693:0:20749:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783138001.385698:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138001.385702:0:20749:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783138001.385706:0:20749:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e3f362499c0) has no exports 00000020:00000080:2.0:1783138001.385726:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138001.385730:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783138001.385734:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c33a 00000020:00000080:2.0:1783138001.385737:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f3e277800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783138001.385746:0:20749:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e3e0426f000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783138001.385750:0:20749:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3e0426f000 3 00000020:01000004:2.0:1783138001.385753:0:20749:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e3e0426f000 from lustre-MDT0000 00000020:00000080:2.0:1783138001.385769:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138001.385772:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783138001.385774:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f3e273000/lustre-MDT0000_UUID 00000020:00000080:2.0:1783138001.385776:0:20749:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3e273000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783138001.385782:0:20749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783138001.385812:0:20749:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783138001.385817:0:20749:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783138001.385830:0:20749:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783138001.385832:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138001.385835:0:20749:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783138001.385855:0:20749:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e3f2f87b000 e1bc6deb-b70a-4cda-b653-fb67e3bea6e4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783138001.385860:0:20749:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e3e01f1cd40) has exports, disconnecting them 00000020:00080000:2.0:1783138001.385864:0:20749:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e3f2f87b000), last request at 1783137900 00000020:00000080:2.0:1783138001.385879:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c2df 00000020:00010000:2.0:1783138001.385883:0:20749:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9e3f2f87b000: total 2 00000100:00080000:2.0:1783138001.385888:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9e3f2f87b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783138001.385903:0:20749:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3f2f87b000): rc 0 00000020:00080000:2.0:1783138001.385907:0:20749:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e3e01f1cd40) has no exports 00000100:00100000:3.0:1783138001.388782:0:17175:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e3e03a2ee00:17175] 2 exiting: rc = 0 00000100:00100000:3.0:1783138001.388910:0:17174:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e3e03a2fe00:17174] 1 exiting: rc = 0 00000020:00000080:3.0:1783138001.388949:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f341f1800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783138001.388986:0:8:0:(genops.c:906:class_export_put()) final put ffff9e3f341f7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783138001.388994:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f341f7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1783138001.388999:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783138001.389083:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3e270800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1783138001.389088:0:8:0:(genops.c:906:class_export_put()) final put ffff9e3f3e275800/lustre-MDD0000_UUID 00000020:00000080:3.0:1783138001.389089:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3e275800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1783138001.389093:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1783138001.389119:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3e277800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1783138001.431276:0:19710:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9e3f2f87b000: total 0 00010000:00010000:0.0:1783138001.431288:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138001.432001:0:19710:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e3f2f87b000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1783138001.432050:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e041f8200/0x50a9699713c4c540 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c539 expref: 14 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432071:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e041f9a00/0x50a9699713c4c69e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c697 expref: 13 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432084:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e041f9000/0x50a9699713c4c3fe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c3f7 expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432097:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f36320200/0x50a9699713c4c56a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c563 expref: 11 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432108:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028ff200/0x50a9699713c4c896 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c88f expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432118:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028b9800/0x50a9699713c4c4bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c4b4 expref: 9 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432148:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028b8400/0x50a9699713c4c40c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c405 expref: 8 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432161:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028b9c00/0x50a9699713c4c6c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c6c1 expref: 7 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432172:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e041f9800/0x50a9699713c4c2ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c2e6 expref: 6 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432182:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f341ff600/0x50a9699713c4c888 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c881 expref: 5 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432192:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f341fe000/0x50a9699713c4c8a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c89d expref: 4 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432204:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e041f8600/0x50a9699713c4c41a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c413 expref: 3 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432217:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e041f9400/0x50a9699713c4c707 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x50a9699713c4c700 expref: 2 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138001.432228:0:19710:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e3f2f87b000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1783138001.432250:0:19710:0:(genops.c:906:class_export_put()) final put ffff9e3f2f87b000/e1bc6deb-b70a-4cda-b653-fb67e3bea6e4 00010000:00010000:0.0:1783138001.432617:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138001.432621:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138001.432623:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138001.432683:0:17173:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e3e03430e00:17173] 0 exiting: rc = 1 00000020:00000080:3.0:1783138001.432762:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f2f87b000/e1bc6deb-b70a-4cda-b653-fb67e3bea6e4 for MGS 00000020:00000080:3.0:1783138001.432801:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f2f87b800 for MGS 00000100:00100000:2.0:1783138001.436296:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436309:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436338:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436344:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436350:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436356:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436361:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436366:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436372:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436377:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436383:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436397:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436403:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436408:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436413:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436418:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436424:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436431:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436436:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436442:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436448:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436454:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436475:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436481:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436487:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436492:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436497:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436503:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436507:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436512:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436518:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436524:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436529:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436534:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436539:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436543:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436549:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436555:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436560:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436565:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436570:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436579:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436585:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436590:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436596:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436602:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436607:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436612:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436616:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436622:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436626:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436631:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436636:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436641:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436646:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436651:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436655:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436669:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436674:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436691:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436696:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436702:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436708:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138001.436713:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1783138001.447042:0:20749:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e3e01f92c00 - data ffff9e3f1ff3ae58/ffff9e3e026a8400 00000020:01000000:3.0:1783138001.447832:0:20749:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e3e02887240 - data ffff9e3f1fd82bd0/ffff9e3f33b94000 00000020:00000080:3.0:1783138001.452605:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c2c3 00000020:00000080:3.0:1783138001.452621:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3e0426c000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783138001.452648:0:20749:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e3e0426f000 from MGS, refs=2 00000020:01000004:3.0:1783138001.452652:0:20749:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3e0426f000 2 00000020:01000004:3.0:1783138001.452655:0:20749:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e3e0426f000 from MGS 00000020:00000080:3.0:1783138001.452694:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783138001.452702:0:20749:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783138001.452705:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3e0426e800/MGS 00000020:00000080:3.0:1783138001.452708:0:20749:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0426e800/MGS for MGS 00000020:01000000:3.0:1783138001.452715:0:20749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1783138001.452780:0:20749:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1783138001.452785:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138001.452790:0:20749:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783138001.452797:0:20749:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e3f340c7000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783138001.452802:0:20749:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9e3e03913380) has exports, disconnecting them 00000020:00080000:3.0:1783138001.452807:0:20749:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e3f340c7000), last request at 1783137901 00000020:00000080:3.0:1783138001.452811:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c3c6 00000020:00080000:3.0:1783138001.452826:0:20749:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3f340c7000): rc 0 00000020:00000080:3.0:1783138001.452832:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3f340c7000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783138001.453831:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0426c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783138001.453858:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f340c7000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1783138001.455401:0:20749:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1783138001.455409:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783138001.455413:0:20749:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783138001.455420:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783138001.455555:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138001.455563:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1783138001.455570:0:20749:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3e0426f000 1 00000020:00000080:2.0:1783138001.455577:0:20749:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c2b5 00000020:00000080:2.0:1783138001.455586:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3e0426a000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1783138001.455590:0:20749:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1783138001.455596:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138001.455599:0:20749:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783138001.455602:0:20749:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e3e01f199c0) has no exports 00000020:00000080:0.0:1783138001.455921:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f36023800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783138001.455931:0:8:0:(genops.c:906:class_export_put()) final put ffff9e3f36023000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783138001.455946:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f36023000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783138001.455963:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783138001.456069:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0426a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783138001.576813:0:20749:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138001.576827:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783138001.576832:0:20749:0:(genops.c:906:class_export_put()) final put ffff9e3e0426d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783138001.576837:0:20749:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0426d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783138001.576843:0:20749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783138001.576986:0:20749:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9e3e0426b800 00000020:02000400:0.0:1783138001.577057:0:20749:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1783138002.042871:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138002.297820:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175901952:0@lo:400:kworker.0 00000100:00100000:1.0:1783138002.297820:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175901696:0@lo:400:kworker.0 00000100:00100000:0.0:1783138002.297879:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175901440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783138002.298378:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138002.298416:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175902208:0@lo:400:kworker.0 00000100:00100000:1.0:1783138002.298444:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138002.298471:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783138002.298478:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175901824:0@lo:400:kworker.0 00000100:00100000:1.0:1783138002.298504:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138002.298523:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869755175902336:0@lo:400:kworker.0 00000100:00100000:1.0:1783138002.298545:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138002.299741:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175902208 00000100:00100000:1.0:1783138002.299751:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175902208 00000100:00100000:1.0:1783138002.299809:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175902336 00000100:00100000:1.0:1783138002.299813:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175902336 00000100:00100000:1.0:1783138002.299847:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783138002.299856:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869755175902336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138002.299920:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869755175902336:12345-0@lo:400:kworker.0 Request processed in 64us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138002.299927:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783138002.299944:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783138002.299964:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3660:x1869755175902208:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783138002.299969:0:17182:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783138002.299996:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3660:x1869755175902208:12345-0@lo:400:kworker.0 Request processed in 32us (1551us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783138002.300003:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783138002.300020:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175901824 00000100:00100000:1.0:1783138002.300024:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175901824 00000100:00100000:1.0:1783138002.300053:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783138002.300060:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175901824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138002.300091:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175901824:12345-0@lo:400:kworker.0 Request processed in 32us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138002.300097:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1783138002.300118:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783138002.300122:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783138002.300156:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175901824:0@lo:400:kworker.0 00010000:00080000:1.0:1783138002.300172:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e3f362e5180 x1869755175902336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138002.300181:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869755175902336:0@lo:400:kworker.0 00000100:00080000:1.0:1783138002.300192:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783138002.300203:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9e3f0afb3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783138002.300206:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1783138002.300340:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138002.300367:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3659:1869755175901568:0@lo:400:kworker.0 00000400:00000100:0.0:1783138002.300458:0:3659:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869755175901568 offset 0 length 224: 4 00000100:00100000:0.0:1783138002.300485:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869755175902080:0@lo:400:kworker.0 00000100:00100000:0.0:1783138002.300512:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138002.300530:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869755175902592:0@lo:400:kworker.0 00000100:00100000:0.0:1783138002.300551:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138002.300583:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175901440 00000100:00100000:0.0:1783138002.300587:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175901440 00000100:00100000:0.0:1783138002.300624:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783138002.300632:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175901440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783138002.300657:0:18689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783138002.300697:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175901440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138002.300704:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783138002.300754:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175901440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783138002.300919:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138002.300943:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869755175902464:0@lo:400:kworker.0 00000100:00100000:2.0:1783138002.301037:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138002.301078:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175902080 00000100:00100000:0.0:1783138002.301083:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175902080 00000100:00100000:0.0:1783138002.301118:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175902592 00000100:00100000:0.0:1783138002.301122:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175902592 00000100:00100000:0.0:1783138002.301138:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175902464 00000100:00100000:0.0:1783138002.301140:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175902464 00000100:00100000:0.0:1783138002.301150:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783138002.301156:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869755175902592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138002.301352:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175901696 00000100:00100000:3.0:1783138002.301359:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175901696 00000100:00100000:3.0:1783138002.301396:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783138002.301399:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175901952 00000100:00100000:2.0:1783138002.301404:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175901952 00000100:00100000:3.0:1783138002.301416:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3660:x1869755175901696:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783138002.301423:0:17186:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783138002.301574:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783138002.301594:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175901952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138002.301678:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869755175902592:12345-0@lo:400:kworker.0 Request processed in 520us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138002.301685:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783138002.301700:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783138002.301704:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1869755175902080:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783138002.301709:0:20133:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783138002.301734:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1869755175902080:12345-0@lo:400:kworker.0 Request processed in 28us (1222us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783138002.301740:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783138002.301751:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783138002.301755:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1869755175902464:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783138002.301759:0:20133:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783138002.301893:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3660:x1869755175901696:12345-0@lo:400:kworker.0 Request processed in 477us (3515us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783138002.301901:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783138002.302139:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1869755175902464:12345-0@lo:400:kworker.0 Request processed in 381us (1101us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783138002.302147:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1783138002.302182:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783138002.302187:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9e3e0403b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783138002.302191:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783138002.302203:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9e3e0403b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138002.302207:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 578 00000100:00080000:0.0:1783138002.302212:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e3e0403b000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138002.302239:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e03b02300 x1869755175902720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783138002.302263:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869755175902080:0@lo:400:kworker.0 00010000:00080000:0.0:1783138002.302278:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e3f2f880e00 x1869755175902592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138002.302289:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869755175902592:0@lo:400:kworker.0 00000100:00080000:3.0:1783138002.302363:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783138002.302368:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783138002.302371:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783138002.302375:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138002.302378:0:3658:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 612 00000100:00080000:3.0:1783138002.302382:0:3658:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e3e0341a800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1783138002.302397:0:3658:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2f8c4380 x1869755175902848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138002.302483:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869755175902464:0@lo:400:kworker.0 00000100:00100000:2.0:1783138002.302553:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175901952:12345-0@lo:400:kworker.0 Request processed in 961us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138002.302561:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783138002.302600:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869755175902720:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783138002.302632:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138002.302649:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869755175902848:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783138002.302667:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138002.302717:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175901952:0@lo:400:kworker.0 00000100:00100000:2.0:1783138002.303384:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175902720 00000100:00100000:2.0:1783138002.303392:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175902720 00000100:00100000:2.0:1783138002.303413:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175902848 00000100:00100000:2.0:1783138002.303415:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175902848 00000100:00100000:2.0:1783138002.303427:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783138002.303433:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869755175902720:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1783138002.303462:0:17181:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783138002.303932:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783138002.303939:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869755175902848:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1783138002.303962:0:20133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783138002.304038:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869755175902848:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 97us (1369us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783138002.304045:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1783138002.304471:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138002.304478:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783138002.304483:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869755175902848:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1783138002.307422:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783138002.307433:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783138002.313214:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9e3f0afb3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138002.313224:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 595 00000100:00080000:1.0:1783138002.313575:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e3f0afb3800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1783138002.313617:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2f881180 x1869755175902976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783138002.313646:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175902208:0@lo:400:kworker.0 00000100:00080000:1.0:1783138002.313695:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783138002.313699:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9e3f07d6e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783138002.313702:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783138002.313706:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9e3f07d6e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138002.313709:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 578 00000100:00080000:1.0:1783138002.313713:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e3f07d6e000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1783138002.313726:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2f882d80 x1869755175903104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783138002.313735:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175901696:0@lo:400:kworker.0 00000100:00100000:0.0:1783138002.313813:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869755175902976:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1783138002.313886:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138002.313922:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175903104:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1783138002.313957:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138002.314078:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175902976 00000100:00100000:1.0:1783138002.314085:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175902976 00000100:00100000:1.0:1783138002.314121:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783138002.314128:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869755175902976:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1783138002.314147:0:20133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783138002.314185:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869755175902976:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 57us (299us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783138002.314204:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1783138002.314383:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f0afb3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138002.314389:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783138002.314392:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869755175902976:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1783138002.317849:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175903104 00000100:00100000:3.0:1783138002.317861:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175903104 00000100:00100000:3.0:1783138002.317926:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783138002.317934:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1869755175903104:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1783138002.317967:0:17186:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783138002.318051:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1869755175903104:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 117us (4102us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783138002.318058:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1783138002.318356:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f07d6e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138002.318368:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783138002.318373:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175903104:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1783138002.350190:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869755175902720:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 46748us (47551us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783138002.350206:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1783138002.356004:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e0403b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138002.356019:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783138002.356024:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869755175902720:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1783138003.065392:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138003.323607:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783138003.323632:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175903232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138003.323707:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138003.323749:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175903232 00000100:00100000:0.0:1783138003.323757:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175903232 00000100:00100000:0.0:1783138003.323799:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783138003.323808:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175903232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783138003.323840:0:18689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138003.323885:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175903232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138003.323892:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783138003.323935:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175903232:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783138004.089601:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783138005.101449:0:20951:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:1.0:1783138005.117560:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783138005.120462:0:20951:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1783138005.120516:0:20951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8a00/0x50a9699713c4c4b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c4bb expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.120530:0:20951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8a00/0x50a9699713c4c4b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c4bb expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.120537:0:20951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8a00/0x50a9699713c4c4b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c4bb expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.120545:0:20951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8a00/0x50a9699713c4c4b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c4bb expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.120574:0:20951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783138005.120581:0:20951:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1783138005.120603:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1783138005.120605:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138005.120610:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1783138005.120610:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8a00/0x50a9699713c4c4b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c4bb expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783138005.120614:0:20951:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1783138005.120617:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8a00 already unused, calling callback (ffffffffc14ecc20) 00000100:00080000:3.0:1783138005.120619:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9e3e0403b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 10000000:00010000:2.0:1783138005.120621:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8a00/0x50a9699713c4c4b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c4bb expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783138005.120623:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138005.120625:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783138005.120628:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783138005.120645:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8a00/0x50a9699713c4c4b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c4bb expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138005.120653:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8a00/0x50a9699713c4c4b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c4bb expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138005.120659:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783138005.120661:0:17168:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783138005.120664:0:17168:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783138005.120699:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8a00/0x50a9699713c4c4b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c4bb expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138005.120705:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138005.120738:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8a00/0x50a9699713c4c4b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c4bb expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138005.120745:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8a00/0x50a9699713c4c4b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c4bb expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138005.120756:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138005.120757:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138005.120759:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138005.120803:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3661:1869755175903360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138005.120867:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138005.120977:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175903360 00000100:00100000:2.0:1783138005.120984:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175903360 00000100:00100000:2.0:1783138005.121025:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783138005.121032:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3661:x1869755175903360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783138005.121038:0:17165:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783138005 with bad export cookie 5812292891690975967 00010000:00010000:3.0:1783138005.121531:0:20951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f36321800/0x50a9699713c4c413 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c41a expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121542:0:20951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f36321800/0x50a9699713c4c413 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c41a expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121548:0:20951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f36321800/0x50a9699713c4c413 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c41a expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121555:0:20951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3f36321800/0x50a9699713c4c413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c41a expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121567:0:20951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138005.121572:0:20951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f36320e00/0x50a9699713c4c700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c707 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121579:0:20951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f36320e00/0x50a9699713c4c700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c707 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121585:0:20951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f36320e00/0x50a9699713c4c700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c707 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121592:0:20951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3f36320e00/0x50a9699713c4c700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c707 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121602:0:20951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783138005.121608:0:20951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe200/0x50a9699713c4c89d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c8a4 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121615:0:20951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe200/0x50a9699713c4c89d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c8a4 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121630:0:20951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe200/0x50a9699713c4c89d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c8a4 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121637:0:20951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe200/0x50a9699713c4c89d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c8a4 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121650:0:20951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783138005.121655:0:20951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8e00/0x50a9699713c4c405 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c40c expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121662:0:20951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8e00/0x50a9699713c4c405 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c40c expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121668:0:20951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8e00/0x50a9699713c4c405 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c40c expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121674:0:20951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8e00/0x50a9699713c4c405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c40c expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.121682:0:20951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1783138005.121685:0:20951:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1783138005.121706:0:20951:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1783138005.121709:0:20951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1783138005.121713:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138005.121718:0:20951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1783138005.121724:0:20951:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9e3e0341a000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783138005.121729:0:20951:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9e3e0413b800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783138005.121734:0:20951:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9e3f2a838000) has exports, disconnecting them 00000020:00080000:3.0:1783138005.121744:0:20951:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e3e0341a000), last request at 1783138002 00000020:00000080:3.0:1783138005.121751:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c6f2 00000100:00080000:3.0:1783138005.121765:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341c000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783138005.121809:0:20951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3e0341a000): rc 0 00000020:00000080:3.0:1783138005.121811:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3e0341a000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1783138005.121820:0:20951:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e3e0413b800), last request at 1783138002 00000020:00000080:3.0:1783138005.121823:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c594 00000100:00080000:3.0:1783138005.121828:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783138005.121834:0:20951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3e0413b800): rc 0 00000020:00000080:3.0:1783138005.121835:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3e0413b800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1783138005.121842:0:20951:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbaa8c1cfbae0 00000100:00080000:3.0:1783138005.121858:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138005.121861:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783138005.122720:0:20951:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783138005.122728:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9e3f07d6e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1783138005.122769:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783138005.122776:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f36321800/0x50a9699713c4c413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c41a expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.122785:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f36321800 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:3.0:1783138005.122788:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f36321800/0x50a9699713c4c413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c41a expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.122797:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f36321800/0x50a9699713c4c413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c41a expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138005.122805:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f36321800/0x50a9699713c4c413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c41a expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138005.122826:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783138005.122829:0:17168:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1783138005.122832:0:17168:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1783138005.122864:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f36321800/0x50a9699713c4c413 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c41a expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.122871:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138005.122891:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f36321800/0x50a9699713c4c413 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c41a expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.122898:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f36321800/0x50a9699713c4c413 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c41a expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.122910:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783138005.122914:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f36320e00/0x50a9699713c4c700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c707 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.122919:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f36320e00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:3.0:1783138005.122922:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f36320e00/0x50a9699713c4c700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c707 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.122948:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f36320e00/0x50a9699713c4c700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c707 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138005.122955:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f36320e00/0x50a9699713c4c700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c707 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138005.122961:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783138005.122963:0:17168:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783138005.122970:0:17168:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783138005.122985:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f36320e00/0x50a9699713c4c700 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c707 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.122991:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138005.122997:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f36320e00/0x50a9699713c4c700 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c707 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123004:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f36320e00/0x50a9699713c4c700 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c707 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123016:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138005.123019:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe200/0x50a9699713c4c89d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c8a4 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123025:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028fe200 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:3.0:1783138005.123028:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe200/0x50a9699713c4c89d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c8a4 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123034:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe200/0x50a9699713c4c89d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c8a4 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138005.123041:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe200/0x50a9699713c4c89d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c8a4 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138005.123047:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783138005.123049:0:17168:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783138005.123051:0:17168:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783138005.123076:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe200/0x50a9699713c4c89d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c8a4 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123082:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138005.123097:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe200/0x50a9699713c4c89d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c8a4 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123104:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe200/0x50a9699713c4c89d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c8a4 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123113:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138005.123116:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8e00/0x50a9699713c4c405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c40c expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123122:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8e00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:3.0:1783138005.123125:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8e00/0x50a9699713c4c405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c40c expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123132:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8e00/0x50a9699713c4c405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c40c expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783138005.123138:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8e00/0x50a9699713c4c405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c40c expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138005.123143:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783138005.123145:0:17168:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783138005.123147:0:17168:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783138005.123160:0:17168:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8e00/0x50a9699713c4c405 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c40c expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123166:0:17168:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783138005.123171:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8e00/0x50a9699713c4c405 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c40c expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123177:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8e00/0x50a9699713c4c405 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x50a9699713c4c40c expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138005.123198:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138005.123200:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138005.123202:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138005.123220:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3658:1869755175903488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783138005.123276:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138005.123349:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783138005.123355:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f36225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3658:1869755175903616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783138005.123375:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138005.123400:0:17166:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1783138005.123408:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1783138005.123772:0:17167:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783138005.123781:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175903488 00000100:00100000:0.0:1783138005.123787:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175903488 00000100:00100000:0.0:1783138005.123821:0:17167:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783138005.123827:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175903616 00000100:00100000:0.0:1783138005.123830:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175903616 00010000:00010000:0.0:1783138005.123845:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783138005.123862:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0341a000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1783138005.123912:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0413b800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1783138005.123941:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e0341c000 for lustre-MDT0001 00000020:00000080:0.0:1783138005.123945:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e0413e800 for lustre-MDT0001 00000100:00100000:0.0:1783138005.124073:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3661:1869755175903872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138005.124107:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138005.124127:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783138005.124132:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3661:1869755175903744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138005.124152:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138005.124166:0:17167:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783138005.124171:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175903872 00000100:00100000:0.0:1783138005.124173:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175903872 00000100:00100000:0.0:1783138005.124185:0:17167:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783138005.124188:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175903744 00000100:00100000:0.0:1783138005.124190:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175903744 00000100:00100000:0.0:1783138005.124299:0:20952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783138005.124306:0:20952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a985c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3658:x1869755175903488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783138005.124337:0:20952:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783138005 with bad export cookie 5812292891690975967 00000100:00100000:0.0:1783138005.124379:0:20952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a985c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3658:x1869755175903488:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1103us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783138005.124386:0:20952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1783138005.124413:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783138005.124417:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9e3e043a0800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783138005.124421:0:3658:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1783138005.128082:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138005.128519:0:20952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783138005.128531:0:20952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a986680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3658:x1869755175903616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783138005.128539:0:20952:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783138005 with bad export cookie 5812292891690975967 00000100:00100000:1.0:1783138005.128625:0:20952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a986680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3658:x1869755175903616:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (5248us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783138005.128633:0:20952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783138005.128657:0:20952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783138005.128662:0:20952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3661:x1869755175903872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783138005.128666:0:20952:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783138005 with bad export cookie 5812292891690975967 00000100:00100000:1.0:1783138005.128704:0:20952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3661:x1869755175903872:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (4596us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783138005.128710:0:20952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783138005.128722:0:20952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783138005.128727:0:20952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3661:x1869755175903744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783138005.128731:0:20952:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783138005 with bad export cookie 5812292891690975967 00000100:00100000:1.0:1783138005.128757:0:20952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3661:x1869755175903744:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (4603us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783138005.128763:0:20952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1783138005.130731:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783138005.130739:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1783138005.130757:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783138005.130818:0:20951:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783138005.130844:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9e3e02574000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783138005.130868:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783138005.130870:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1783138005.130878:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783138005.130957:0:20951:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783138005.130966:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9e3f3638d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783138005.131004:0:20951:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9e3f2a838000) has no exports 00000100:00100000:3.0:1783138005.131040:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175904000:0@lo:9:umount.0 00000100:00100000:3.0:1783138005.131101:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138005.131128:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175904128:0@lo:9:umount.0 00000100:00100000:3.0:1783138005.131148:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138005.131514:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175904000 00000100:00100000:1.0:1783138005.131522:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175904000 00000100:00100000:1.0:1783138005.131571:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175904128 00000100:00100000:1.0:1783138005.131574:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175904128 00000100:00100000:1.0:1783138005.131595:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783138005.131604:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1869755175904000:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783138005.131640:0:18687:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c5be 00000100:00080000:1.0:1783138005.131648:0:18687:0:(import.c:65:import_set_state_nolock()) ffff9e3f0afb6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783138005.131684:0:18687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1783138005.131809:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3657:x1869755175904000:12345-0@lo:9:umount.0 Request processed in 205us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138005.131816:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783138005.131829:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783138005.131835:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1869755175904128:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783138005.131846:0:18687:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c723 00000100:00080000:1.0:1783138005.131850:0:18687:0:(import.c:65:import_set_state_nolock()) ffff9e3e039b9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783138005.131867:0:18687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1783138005.131945:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3657:x1869755175904128:12345-0@lo:9:umount.0 Request processed in 110us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138005.131952:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1783138005.131969:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783138005.131972:0:17176:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783138005.131997:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e02574000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783138005.132004:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783138005.132006:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783138005.132009:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175904000:0@lo:9:umount.0 00000100:00080000:1.0:1783138005.132019:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f3638d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783138005.132025:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783138005.132026:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783138005.132028:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175904128:0@lo:9:umount.0 00010000:00010000:1.0:1783138005.132055:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783138005.132554:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1783138005.133654:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3661:x1869755175903360:12345-0@lo:103:ldlm_bl.0 Request processed in 12618us (12784us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783138005.133677:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1783138005.145996:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783138005.156303:0:18681:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783138005.156347:0:18681:0:(genops.c:906:class_export_put()) final put ffff9e3f0afb5000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1783138005.156366:0:18681:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783138005.156368:0:18681:0:(genops.c:906:class_export_put()) final put ffff9e3f3f92f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783138005.156384:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f0afb5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783138005.156438:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3f92f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783138005.156454:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f0afb6800 for lustre-OST0000 00000020:00000080:3.0:1783138005.156459:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f3f92c800 for lustre-OST0000 00000100:00080000:0.0:1783138005.169155:0:3658:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.143@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783138005.169162:0:3658:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783138005.169172:0:3658:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f362e5500 x1869755175901568/t0(0) o400->MGC192.168.203.143@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783138018 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138005.169428:0:3658:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f3f48dc00 x1869755175903360/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783138021 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138005.169439:0:3658:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f8c4380 x1869755175903488/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783138021 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138005.169446:0:3658:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f36225500 x1869755175903616/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783138021 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138005.169454:0:3658:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2a987800 x1869755175903872/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783138021 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138005.169462:0:3658:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2a984380 x1869755175903744/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783138021 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138005.169560:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3659:1869755175901568:0@lo:400:kworker.0 10000000:01000000:0.0:1783138005.169580:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783138005.169583:0:3658:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783138005.169585:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783138005.173383:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9e3e043a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138005.173398:0:3658:0:(import.c:512:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 562 00000100:00080000:0.0:1783138005.173407:0:3658:0:(import.c:626:import_select_connection()) MGC192.168.203.143@tcp: import ffff9e3e043a0800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138005.173471:0:3658:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e03b00a80 x1869755175904256/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138005.173550:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3657:1869755175904256:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1783138005.173599:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869755175904256 offset 0 length 520: 4 00000100:00100000:0.0:1783138005.173677:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f36225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3658:1869755175903616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138005.173684:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3658:1869755175903488:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783138005.180171:0:3661:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e3e043a0800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:2.0:1783138005.180279:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3661:1869755175903872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138005.180290:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3661:1869755175903360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138005.180346:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3661:1869755175903744:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1783138005.184847:0:20951:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9e3f2a838000) has no exports 00000020:01000000:2.0:1783138005.293178:0:20951:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e3f0b88d5a0 - data ffff9e3f1fc901b0/ffff9e3f35f7fc00 00000020:01000000:2.0:1783138005.293366:0:20951:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e3f3e2a3420 - data ffff9e3f1fc590d8/ffff9e3f04172c00 00000001:00000004:2.0:1783138005.302605:0:20951:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1783138005.340699:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138005.340708:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783138005.340715:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783138005.348042:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783138005.348049:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1783138005.348060:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783138005.348063:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783138005.348949:0:17920:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783138005.348956:0:17920:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1783138005.348968:0:17920:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1783138005.349690:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783138005.349695:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1783138005.349704:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783138005.349706:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783138005.352917:0:17922:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783138005.352934:0:17922:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1783138005.352949:0:17922:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1783138005.354920:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c428 00000020:00000080:3.0:1783138005.354941:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f340c3000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1783138005.355596:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f340c3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783138005.355999:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c43d 00000020:00000080:3.0:1783138005.356007:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f07bd6800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783138005.356024:0:20951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1783138005.356030:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138005.356038:0:20951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783138005.356043:0:20951:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e3f2a8399c0) has no exports 00000020:00000080:0.0:1783138005.356306:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f07bd6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1783138005.356551:0:20951:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783138005.356559:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c491 00000020:00000080:3.0:1783138005.356564:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f3638f800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1783138005.356610:0:20951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1783138005.356615:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138005.356620:0:20951:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783138005.356623:0:20951:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9e3e01f1b380) has no exports 00000020:00000080:3.0:1783138005.356630:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c48a 00000020:00000080:3.0:1783138005.356633:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3e02570000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1783138005.358353:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3638f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:0.0:1783138005.359761:0:20951:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1783138005.359768:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783138005.359772:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1783138005.359779:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783138005.359782:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783138005.360309:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e02570000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1783138005.361048:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138005.361061:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783138005.361070:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c47c 00000020:00000080:0.0:1783138005.361080:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3e02576000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1783138005.361087:0:20951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1783138005.361092:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138005.361097:0:20951:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783138005.361112:0:20951:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9e3e01f18000) has no exports 00000020:00000080:0.0:1783138005.361121:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c475 00000020:00000080:0.0:1783138005.361125:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f36389000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1783138005.361544:0:20951:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1783138005.361548:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783138005.361553:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1783138005.361557:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783138005.361559:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783138005.361585:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138005.361590:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1783138005.361602:0:20951:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783138005.361608:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c460 00000020:00000080:0.0:1783138005.361613:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f3638d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1783138005.361617:0:20951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1783138005.361620:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138005.361623:0:20951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783138005.361625:0:20951:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9e3f2a83b380) has no exports 00000020:00000080:0.0:1783138005.361629:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c459 00000020:00000080:0.0:1783138005.361631:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f3638b800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783138005.362936:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f3638d000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1783138005.362952:0:37:0:(genops.c:906:class_export_put()) final put ffff9e3e02577800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783138005.362956:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e02577800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1783138005.362963:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783138005.363042:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e02576000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1783138005.363048:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f36389000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783138005.363052:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e02574000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1783138005.363057:0:37:0:(genops.c:906:class_export_put()) final put ffff9e3f360a7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783138005.363059:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f360a7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1783138005.363062:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783138005.363087:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3638d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1783138005.363092:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3638b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1783138005.365425:0:20951:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1783138005.365434:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783138005.365439:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783138005.365446:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783138005.365472:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f07d6e000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1783138005.365527:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138005.365538:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783138005.365543:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f3638a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783138005.365546:0:20951:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3638a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1783138005.365552:0:20951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783138005.365706:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138005.365720:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783138005.365723:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f07d69800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783138005.365725:0:20951:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f07d69800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1783138005.365729:0:20951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783138005.365939:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c444 00000020:00000080:1.0:1783138005.365947:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f07bd5000/lustre-MDD0001_UUID 00000020:01000000:1.0:1783138005.365970:0:20951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1783138005.365974:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783138005.365979:0:20951:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783138005.365983:0:20951:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9e3f2a83cd40) has no exports 00000020:00000080:1.0:1783138005.366005:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138005.366008:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1783138005.366012:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c44b 00000020:00000080:1.0:1783138005.366016:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f07bd4800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1783138005.366024:0:20951:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e3e0257c000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1783138005.366027:0:20951:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3e0257c000 2 00000020:01000004:1.0:1783138005.366030:0:20951:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e3e0257c000 from lustre-MDT0001 00000020:00000080:1.0:1783138005.366046:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783138005.366048:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1783138005.366050:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f340c6000/lustre-MDT0001_UUID 00000020:00000080:1.0:1783138005.366052:0:20951:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f340c6000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1783138005.366058:0:20951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1783138005.366084:0:20951:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1783138005.366088:0:20951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1783138005.366090:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783138005.366093:0:20951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783138005.366098:0:20951:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9e3e02571000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:3.0:1783138005.366190:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f07bd5000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1783138005.366195:0:37:0:(genops.c:906:class_export_put()) final put ffff9e3f07d6c800/lustre-MDD0001_UUID 00000020:00000080:3.0:1783138005.366197:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f07d6c800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1783138005.366203:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1783138005.366347:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f07bd4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00080000:1.0:1783138005.366683:0:20951:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9e3f04458000) has exports, disconnecting them 00000020:00080000:1.0:1783138005.366689:0:20951:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9e3e02571000), last request at 1783137916 00000020:00000080:1.0:1783138005.366693:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c4c9 00000020:00080000:1.0:1783138005.366703:0:20951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3e02571000): rc 0 00000020:00000080:1.0:1783138005.366714:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3e02571000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1783138005.366890:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e02571000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1783138005.380410:0:20951:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1783138005.380420:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138005.380425:0:20951:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783138005.380434:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783138005.380470:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e0403b000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1783138005.380614:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783138005.380622:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1783138005.380627:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3f3e298800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1783138005.380632:0:20951:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3e298800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1783138005.380637:0:20951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1783138005.380702:0:20951:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3e0257c000 1 00000020:00000080:3.0:1783138005.380707:0:20951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c3f0 00000020:00000080:3.0:1783138005.380713:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3e0257f800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1783138005.380721:0:20951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1783138005.380729:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0257f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783138005.380749:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138005.380754:0:20951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783138005.380758:0:20951:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9e3e02714d40) has no exports 00000020:00000080:3.0:1783138005.438007:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783138005.438024:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1783138005.438030:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3e0257a000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783138005.438035:0:20951:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0257a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1783138005.438046:0:20951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1783138005.439178:0:20951:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9e3e02579000 00000020:01000000:3.0:1783138005.439214:0:20951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783138005.439218:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138005.439223:0:20951:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783138005.439227:0:20951:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e3e02710000) has no exports 00000100:00100000:1.0:1783138005.440339:0:17182:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e3f3435ae00:17182] 2 exiting: rc = 0 00000100:00100000:1.0:1783138005.440464:0:17180:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e3f3435ac00:17180] 0 exiting: rc = 1 00000100:00100000:1.0:1783138005.440541:0:17181:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e3f3435b000:17181] 1 exiting: rc = 0 00000100:00100000:3.0:1783138005.441745:0:20133:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e3e041d6e00:20133] 3 exiting: rc = 0 00000100:00100000:0.0:1783138005.442148:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442169:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442175:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442181:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442187:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442195:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442200:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442205:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442211:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442216:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442221:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442227:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442234:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442239:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442245:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442250:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442256:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442263:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442281:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442287:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442294:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442299:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442305:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442339:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442346:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442351:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442356:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442362:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442367:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442373:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442378:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442384:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442391:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442397:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442402:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442407:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442421:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442426:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442432:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442437:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442442:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442448:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442453:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442457:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442462:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442466:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442471:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442478:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442483:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442489:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442494:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442499:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442505:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442510:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442516:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442521:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442526:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442531:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442536:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442542:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442547:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442552:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442557:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.442563:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138005.449006:0:17184:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e3f3435b400:17184] 1 exiting: rc = 0 00000100:00100000:0.0:1783138005.449283:0:17183:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e3f3435aa00:17183] 0 exiting: rc = 1 00000100:00100000:1.0:1783138005.449440:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449449:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449457:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449463:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449468:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449473:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449479:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449484:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449488:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449493:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449499:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449504:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449510:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449515:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449521:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449527:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449532:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449538:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449542:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449548:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449553:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449558:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449564:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449569:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449574:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449579:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449584:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449590:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449595:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449601:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449620:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449625:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449630:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449635:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449641:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449646:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449651:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449656:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449661:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449667:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449671:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449677:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449681:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449687:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449692:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449698:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449703:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449707:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449712:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449718:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449722:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449727:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449733:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449738:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449744:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449749:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449755:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449760:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449765:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449770:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449775:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449781:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449786:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.449792:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138005.450503:0:17186:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e3e0376b600:17186] 1 exiting: rc = 0 00000100:00100000:0.0:1783138005.450717:0:17185:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e3e03431400:17185] 0 exiting: rc = 1 00000100:00100000:1.0:1783138005.450817:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450836:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450842:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450848:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450856:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450863:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450869:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450882:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450889:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450894:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450899:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450905:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450911:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450917:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450933:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450940:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450945:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450951:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450955:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450977:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450985:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450991:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.450996:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451003:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451008:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451014:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451020:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451026:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451031:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451038:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451044:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451065:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451072:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451078:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451083:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451090:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451113:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451120:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451125:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451131:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451137:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451143:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451148:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451169:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451176:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451182:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451188:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451194:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451200:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451206:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451212:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451218:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451225:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451233:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451238:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451258:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451265:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451573:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451581:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451587:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451593:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451598:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451604:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.451611:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.464970:0:17187:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e3f06bd4c00:17187] 0 exiting: rc = 1 00000100:00100000:1.0:1783138005.465085:0:17188:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e3f1803c200:17188] 1 exiting: rc = 0 00000100:00100000:0.0:1783138005.465758:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465767:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465771:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465777:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465782:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465803:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465818:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465824:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465829:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465834:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465839:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465845:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465850:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465854:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465859:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465864:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465869:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465874:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465879:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465884:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465889:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465894:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465899:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465905:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465910:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465915:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465920:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465934:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465941:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465946:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465951:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465956:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465961:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465967:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465972:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465978:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465983:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465988:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465993:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.465998:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466011:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466016:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466021:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466026:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466031:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466037:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466042:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466047:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466052:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466058:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466063:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466068:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466073:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466079:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466084:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466089:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466094:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466111:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466117:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466122:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466128:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466134:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466139:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.466144:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.466797:0:17190:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e3e04035800:17190] 1 exiting: rc = 0 00000100:00100000:3.0:1783138005.466972:0:17189:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e3f0999fe00:17189] 0 exiting: rc = 1 00000100:00100000:0.0:1783138005.467051:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467057:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467062:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467067:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467073:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467078:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467084:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467089:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467095:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467113:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467119:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467137:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467143:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467150:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467156:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467161:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467166:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467172:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467177:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467193:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467200:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467205:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467210:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467215:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467221:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467226:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467232:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467237:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467241:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467246:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467251:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467256:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467261:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.467267:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468243:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468248:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468253:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468258:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468263:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468280:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468286:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468291:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468296:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468301:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468305:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468527:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468548:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468553:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468559:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468565:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468570:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468575:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468580:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468585:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468590:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468595:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468600:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468605:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468609:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468614:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468618:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468623:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468628:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.468633:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138005.469086:0:17191:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e3f1f9efc00:17191] 0 exiting: rc = 1 00000100:00100000:3.0:1783138005.469283:0:17192:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e3e04034600:17192] 1 exiting: rc = 0 00000100:00100000:0.0:1783138005.469630:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469637:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469642:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469647:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469653:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469657:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469661:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469665:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469670:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469674:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469679:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469683:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469688:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469694:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469699:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469703:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469708:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469723:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469728:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469733:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469739:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469744:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469749:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469754:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469758:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469763:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469769:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469774:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469779:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469784:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469794:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469800:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469806:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469884:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469889:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469895:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469900:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469905:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469910:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469915:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469920:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469935:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469940:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469944:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469949:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469953:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469958:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469964:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469969:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469975:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469980:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469984:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.469998:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.470003:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.470008:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.470013:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.470018:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.470023:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.470028:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.470032:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.470037:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.470042:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.470046:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.470051:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138005.471774:0:17193:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e3f35dc7600:17193] 0 exiting: rc = 1 00000100:00100000:1.0:1783138005.472440:0:17194:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e3f35f16000:17194] 1 exiting: rc = 0 00000100:00100000:1.0:1783138005.472632:0:17195:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e3f35dc7000:17195] 2 exiting: rc = 0 00000100:00100000:0.0:1783138005.472803:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472821:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472827:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472834:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472840:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472846:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472853:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472859:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472865:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472871:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472877:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472883:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472890:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472895:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472901:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472907:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472912:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472918:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472932:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472938:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472944:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472967:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472974:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472990:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.472995:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473001:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473006:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473011:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473020:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473027:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473032:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473037:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473043:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473049:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473054:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473059:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473065:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473071:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473077:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473082:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473088:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473094:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473099:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473116:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473121:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473142:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473148:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473154:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473159:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473165:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473170:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473175:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473181:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473186:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473191:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473196:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473203:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473208:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473221:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473226:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473232:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473238:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473243:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138005.473248:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783138005.479078:0:20951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138005.479092:0:20951:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1783138005.479501:0:20951:0:(genops.c:906:class_export_put()) final put ffff9e3e043a6000/MDS_uuid 00000020:00000080:0.0:1783138005.479508:0:20951:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e043a6000/MDS_uuid for MDS 00000020:01000000:0.0:1783138005.479519:0:20951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1783138005.479682:0:20951:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1783138006.137515:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138007.169559:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783138007.418951:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783138007.418962:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138007.418965:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783138007.418968:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783138007.418972:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e3f0afb3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138007.418979:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 664 00000100:00080000:2.0:1783138007.418985:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783138007.418993:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e3f0afb3800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138007.419031:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f3f48dc00 x1869755175904384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138007.419073:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783138007.419076:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783138007.419078:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138007.419082:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 664 00000100:00080000:2.0:1783138007.419090:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783138007.419094:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e3e0341a800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138007.419106:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f3f48ca80 x1869755175904640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783138007.419159:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869755175904384:0@lo:38:kworker.0 00000400:00000100:2.0:1783138007.419206:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175904384 offset 0 length 520: 4 00000100:00100000:2.0:1783138007.419231:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869755175904640:0@lo:38:kworker.0 00000400:00000100:2.0:1783138007.419247:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175904640 offset 0 length 520: 4 00000100:00100000:2.0:1783138007.419272:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869755175904768:0@lo:400:kworker.0 00000400:00000100:2.0:1783138007.419289:0:3659:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175904768 offset 0 length 224: 4 00000100:00100000:2.0:1783138007.419302:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783138007.419307:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869755175904512:0@lo:400:kworker.0 00000400:00000100:2.0:1783138007.419342:0:3659:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175904512 offset 0 length 224: 4 00010000:00010000:3.0:1783138008.193459:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138009.210484:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783138009.466933:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138009.466944:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783138009.466947:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138009.466950:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783138009.467000:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138009.467004:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783138009.467188:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869755175905024:0@lo:400:kworker.0 00000400:00000100:2.0:1783138009.467245:0:3661:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175905024 offset 0 length 224: 4 00000100:00100000:2.0:1783138009.467294:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783138009.467301:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869755175904896:0@lo:400:kworker.0 00000400:00000100:2.0:1783138009.467345:0:3661:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175904896 offset 0 length 224: 4 00000020:01000004:0.0:1783138009.817287:0:21153:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783138009.836670:0:21153:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1783138009.836786:0:21153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e041f9200/0x50a9699713c4c563 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c56a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138009.836802:0:21153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e041f9200/0x50a9699713c4c563 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c56a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138009.836809:0:21153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e041f9200/0x50a9699713c4c563 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c56a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138009.836886:0:21153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3e041f9200/0x50a9699713c4c563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c56a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138009.836941:0:21153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783138009.836948:0:21153:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783138009.836970:0:21153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138009.836981:0:21153:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f3f48dc00 x1869755175904384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783138022 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138009.836999:0:21153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783138009.837005:0:21153:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783138009.837012:0:21153:0:(import.c:65:import_set_state_nolock()) ffff9e3f0afb3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1783138009.837017:0:21153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783138009.837021:0:21153:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f3f48dc00 x1869755175904384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783138022 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138009.837028:0:21153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783138009.837032:0:21153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1783138009.837100:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869755175904384:0@lo:38:kworker.0 00000100:00080000:3.0:1783138009.838516:0:21153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783138009.838639:0:21153:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f3f48e680 x1869755175904512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138023 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138009.838714:0:21153:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f881f80 x1869755175904896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138025 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138009.838731:0:21153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783138009.838736:0:21153:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783138009.838761:0:21153:0:(import.c:65:import_set_state_nolock()) ffff9e3f3f92b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783138009.838921:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1869755175904896:0@lo:400:kworker.0 00000100:00100000:2.0:1783138009.838956:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1869755175905152:0@lo:39:umount.0 00000400:00000100:2.0:1783138009.839004:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175905152 offset 0 length 224: 4 00010000:00010000:1.0:1783138009.839178:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138009.839188:0:17168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3e041f9200/0x50a9699713c4c563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c56a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138009.839198:0:17168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9200 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:1.0:1783138009.839202:0:17168:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3e041f9200/0x50a9699713c4c563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c56a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138009.839213:0:17168:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e041f9200/0x50a9699713c4c563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c56a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138009.839221:0:17168:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e041f9200/0x50a9699713c4c563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c56a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138009.839227:0:17168:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783138009.839230:0:17168:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783138009.839235:0:17168:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783138009.839249:0:17168:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e3e043a0800 00010000:00010000:1.0:1783138009.839253:0:17168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3e041f9200/0x50a9699713c4c563 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c56a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138009.839271:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e041f9200/0x50a9699713c4c563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c56a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138009.839284:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138009.839286:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138009.839288:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138009.839462:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869755175904512:0@lo:400:kworker.0 00010000:00010000:3.0:1783138010.234732:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783138011.012027:0:19499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783138011.012037:0:19499:0:(genops.c:906:class_export_put()) final put ffff9e3e039bf800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783138011.012108:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e039bf800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783138011.012161:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e039b9800 for lustre-OST0001 00010000:00010000:1.0:1783138011.257797:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138012.282299:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783138012.473516:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138012.473526:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783138012.473529:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138012.473532:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783138012.473764:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869755175905280:0@lo:400:kworker.0 00000400:00000100:0.0:1783138012.473823:0:3658:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175905280 offset 0 length 224: 4 00010000:00010000:3.0:1783138013.305568:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138014.329503:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138015.353865:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138015.999370:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138005/real 1783138005] req@ffff9e3e03b00a80 x1869755175904256/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783138015 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138015.999404:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3e03b00a80 x1869755175904256/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783138015 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783138015.999423:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e043a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138015.999448:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783138015.999452:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3657:1869755175904256:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1783138016.002134:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138016.002145:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783138016.002150:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e3e043a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138016.002158:0:8:0:(import.c:512:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 666 00000100:00080000:1.0:1783138016.002165:0:8:0:(import.c:591:import_select_connection()) MGC192.168.203.143@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783138016.002173:0:8:0:(import.c:626:import_select_connection()) MGC192.168.203.143@tcp: import ffff9e3e043a0800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1783138016.002212:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2f882680 x1869755175905408/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783138016.002245:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138016.002263:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783138016.002294:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3657:1869755175905408:0@lo:250:kworker.0 00000400:00000100:2.0:1783138016.002382:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869755175905408 offset 0 length 520: 4 00000100:00100000:0.0:1783138016.002535:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869755175905536:0@lo:400:kworker.0 00000400:00000100:0.0:1783138016.002562:0:3659:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175905536 offset 0 length 224: 4 00010000:00010000:3.0:1783138016.377895:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138017.402888:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138018.427629:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138019.065625:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138009/real 1783138009] req@ffff9e3f2a987480 x1869755175905152/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783138019 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138019.065657:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3f2a987480 x1869755175905152/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783138019 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783138019.065677:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f3f92b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783138019.065758:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1869755175905152:0@lo:39:umount.0 00000100:00080000:3.0:1783138019.067426:0:21153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783138019.067435:0:21153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783138019.067441:0:21153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783138019.071609:0:21153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a200/0x50a9699713c4c539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c540 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138019.071628:0:21153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a200/0x50a9699713c4c539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c540 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138019.071636:0:21153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a200/0x50a9699713c4c539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c540 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138019.071643:0:21153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a200/0x50a9699713c4c539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c540 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138019.071736:0:21153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138019.071745:0:21153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff000/0x50a9699713c4c88f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c896 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138019.071752:0:21153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff000/0x50a9699713c4c88f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c896 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138019.071758:0:21153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff000/0x50a9699713c4c88f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c896 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138019.071764:0:21153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff000/0x50a9699713c4c88f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c896 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138019.078563:0:19710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138019.078577:0:19710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a200/0x50a9699713c4c539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c540 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138019.078588:0:19710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f0151a200 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:0.0:1783138019.078592:0:19710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a200/0x50a9699713c4c539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c540 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138019.078602:0:19710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a200/0x50a9699713c4c539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c540 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138019.078631:0:19710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a200/0x50a9699713c4c539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c540 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138019.078637:0:19710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783138019.078640:0:19710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1783138019.078654:0:19710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e3e043a0800 00010000:00010000:0.0:1783138019.078658:0:19710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a200/0x50a9699713c4c539 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c540 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138019.078664:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a200/0x50a9699713c4c539 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c540 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138019.078683:0:19710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138019.078686:0:19710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff000/0x50a9699713c4c88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c896 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138019.078691:0:19710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028ff000 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:0.0:1783138019.078694:0:19710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff000/0x50a9699713c4c88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c896 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138019.078700:0:19710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff000/0x50a9699713c4c88f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c896 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138019.078705:0:19710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff000/0x50a9699713c4c88f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c896 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138019.078709:0:19710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783138019.078711:0:19710:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1783138019.078715:0:19710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e3e043a0800 00010000:00010000:0.0:1783138019.078723:0:19710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff000/0x50a9699713c4c88f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c896 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138019.078730:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138019.078731:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138019.078733:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138019.079592:0:21153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783138019.079610:0:21153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff000/0x50a9699713c4c88f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c896 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138019.079628:0:21153:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1783138019.079634:0:21153:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1783138019.079637:0:21153:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1783138019.079669:0:21153:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1783138019.079673:0:21153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1783138019.079680:0:21153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138019.079685:0:21153:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783138019.079693:0:21153:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9e3f1f9f19c0) has no exports 00000020:00080000:3.0:1783138019.079718:0:21153:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9e3f1f9f19c0) has no exports 00010000:00010000:1.0:1783138019.082258:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1783138019.082701:0:21153:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e3e01f92180 - data ffff9e3f1fdb2948/ffff9e3f045d0400 00000020:01000000:3.0:1783138019.083024:0:21153:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e3f3414b8a0 - data ffff9e3f1fc7ae58/ffff9e3e04283c00 00100000:10000000:3.0:1783138019.093857:0:21153:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783138019.104050:0:21153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c54e 00000020:00000080:2.0:1783138019.104062:0:21153:0:(genops.c:906:class_export_put()) final put ffff9e3e03901800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1783138019.104075:0:21153:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e3f1f986800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1783138019.104079:0:21153:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3f1f986800 2 00000020:01000004:2.0:1783138019.104082:0:21153:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e3f1f986800 from lustre-OST0000 00000020:00000080:2.0:1783138019.104103:0:21153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138019.104112:0:21153:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1783138019.104115:0:21153:0:(genops.c:906:class_export_put()) final put ffff9e3e03907800/lustre-OST0000_UUID 00000020:00000080:2.0:1783138019.104117:0:21153:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e03907800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1783138019.104125:0:21153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1783138019.104189:0:21153:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1783138019.104193:0:21153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783138019.104196:0:21153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138019.104201:0:21153:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783138019.104207:0:21153:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e3f0afb3000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783138019.104213:0:21153:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff9e3e03914d40) has exports, disconnecting them 00000020:00080000:2.0:1783138019.104218:0:21153:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e3f0afb3000), last request at 1783137933 00000020:00000080:2.0:1783138019.104221:0:21153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c578 00000020:00080000:2.0:1783138019.104231:0:21153:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3f0afb3000): rc 0 00000020:00000080:2.0:1783138019.104237:0:21153:0:(genops.c:906:class_export_put()) final put ffff9e3f0afb3000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783138019.104276:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e03901800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783138019.104293:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f0afb3000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783138019.218662:0:21153:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783138019.218671:0:21153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783138019.218675:0:21153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783138019.218682:0:21153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783138019.218792:0:16974:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f0afb3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783138019.218841:0:21153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138019.218851:0:21153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1783138019.218857:0:21153:0:(genops.c:906:class_export_put()) final put ffff9e3f36387000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1783138019.218862:0:21153:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f36387000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1783138019.218872:0:21153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1783138019.218945:0:21153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783138019.218950:0:21153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138019.218955:0:21153:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783138019.218961:0:21153:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9e3f3f92e800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783138019.218967:0:21153:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff9e3f2b083380) has exports, disconnecting them 00000020:00080000:2.0:1783138019.218971:0:21153:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9e3f3f92e800), last request at 1783137933 00000020:00000080:2.0:1783138019.218975:0:21153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c58d 00000020:00080000:2.0:1783138019.218987:0:21153:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3f3f92e800): rc 0 00000020:00000080:2.0:1783138019.218991:0:21153:0:(genops.c:906:class_export_put()) final put ffff9e3f3f92e800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1783138019.219097:0:16974:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3f92e800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1783138019.247136:0:21153:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783138019.247146:0:21153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783138019.247150:0:21153:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783138019.247157:0:21153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783138019.247398:0:21153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783138019.247406:0:21153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1783138019.247413:0:21153:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3f1f986800 1 00000020:00000080:3.0:1783138019.247419:0:21153:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c52b 00000020:00000080:3.0:1783138019.247427:0:21153:0:(genops.c:906:class_export_put()) final put ffff9e3e0257d800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1783138019.247655:0:16974:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3f3f92b800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1783138019.247663:0:16974:0:(genops.c:906:class_export_put()) final put ffff9e3f3f929800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1783138019.247666:0:16974:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f3f929800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1783138019.247676:0:16974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000000:3.0:1783138019.247904:0:21153:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1783138019.247910:0:21153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138019.247914:0:21153:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783138019.247918:0:21153:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff9e3f2b084d40) has no exports 00000020:00000080:1.0:1783138019.250730:0:16974:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0257d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783138019.282372:0:21153:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783138019.282384:0:21153:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783138019.282390:0:21153:0:(genops.c:906:class_export_put()) final put ffff9e3f1f982800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783138019.282394:0:21153:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3f1f982800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783138019.282416:0:21153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783138019.282525:0:21153:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9e3f1f983800 00000020:02000400:3.0:1783138019.282567:0:21153:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1783138019.451293:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138020.477380:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783138021.244145:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783138021.244154:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138021.244157:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783138021.244160:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783138021.244231:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783138021.244251:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869755175905664:0@lo:400:kworker.0 00000400:00000100:2.0:1783138021.244306:0:3661:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175905664 offset 0 length 224: 4 00010000:00010000:1.0:1783138021.497484:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138022.137721:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138007/real 1783138007] req@ffff9e3f3f48ca80 x1869755175904640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1783138022 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138022.137752:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3f3f48ca80 x1869755175904640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1783138022 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783138022.137767:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138022.137792:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783138022.137796:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869755175904640:0@lo:38:kworker.0 00000100:00080000:1.0:1783138022.137929:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138022.137935:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783138022.137938:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138022.137941:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783138022.137944:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138022.137950:0:16974:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 669 00000100:00080000:1.0:1783138022.137955:0:16974:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783138022.137961:0:16974:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e3e0341a800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1783138022.137991:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2f882a00 x1869755175905792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783138022.138056:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783138022.138067:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869755175905920:0@lo:400:kworker.0 00000400:00000100:1.0:1783138022.138112:0:3660:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175905920 offset 0 length 224: 4 00000100:00100000:0.0:1783138022.138229:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869755175905792:0@lo:38:kworker.0 00000400:00000100:0.0:1783138022.138251:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175905792 offset 0 length 520: 4 00010000:00010000:2.0:1783138022.521727:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1783138023.161480:0:3659:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138007/real 1783138007] req@ffff9e3f3f48c000 x1869755175904768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783138023 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138023.184622:0:3659:0:(client.c:2533:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9e3f3f48c000 x1869755175904768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783138023 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783138023.184638:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341e000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783138023.184642:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783138023.205748:0:3659:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1783138023.205914:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869755175904768:0@lo:400:kworker.0 00000100:00080000:1.0:1783138023.207981:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138023.207990:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783138023.208011:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138023.208014:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783138023.208017:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783138023.208020:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783138023.208024:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138023.208033:0:16974:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 612 00000100:00080000:1.0:1783138023.208043:0:16974:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e3e0341e000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1783138023.208080:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2f880700 x1869755175906048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783138023.211134:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1869755175906048:0@lo:38:kworker.0 00000400:00000100:0.0:1783138023.211203:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869755175906048 offset 0 length 520: 4 00000020:01000004:0.0:1783138023.377986:0:21356:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783138023.406527:0:21356:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783138023.406614:0:21356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe400/0x50a9699713c4c6c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c6c8 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.406629:0:21356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe400/0x50a9699713c4c6c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c6c8 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.406637:0:21356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe400/0x50a9699713c4c6c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c6c8 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.406644:0:21356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe400/0x50a9699713c4c6c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c6c8 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.406658:0:21356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783138023.406662:0:21356:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783138023.406687:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1783138023.406697:0:19710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1783138023.406701:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f882a00 x1869755175905792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783138042 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783138023.406706:0:19710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe400/0x50a9699713c4c6c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c6c8 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138023.406719:0:19710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f341fe400 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:1.0:1783138023.406723:0:19710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe400/0x50a9699713c4c6c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c6c8 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138023.406731:0:21356:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:1.0:1783138023.406733:0:19710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe400/0x50a9699713c4c6c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c6c8 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783138023.406740:0:21356:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 10000000:00010000:1.0:1783138023.406743:0:19710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe400/0x50a9699713c4c6c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c6c8 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783138023.406747:0:21356:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1783138023.406751:0:19710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783138023.406755:0:19710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:0.0:1783138023.406755:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:1.0:1783138023.406761:0:19710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1783138023.406763:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f882a00 x1869755175905792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783138042 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.406772:0:21356:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:1.0:1783138023.406776:0:19710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e3e043a0800 00000100:00100000:0.0:1783138023.406776:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:1.0:1783138023.406798:0:19710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe400/0x50a9699713c4c6c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c6c8 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138023.406805:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe400/0x50a9699713c4c6c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c6c8 expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138023.406815:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138023.406817:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138023.406819:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138023.406823:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869755175905792:0@lo:38:kworker.0 00000100:00080000:0.0:1783138023.409471:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783138023.409486:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f881880 x1869755175905024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138025 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409511:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f880a80 x1869755175905280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138028 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409543:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f883480 x1869755175905536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138032 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409561:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f3f48dc00 x1869755175905664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138037 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409571:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f883b80 x1869755175905920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138038 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409581:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f880700 x1869755175906048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783138033 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409592:0:21356:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783138023.409597:0:21356:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783138023.409602:0:21356:0:(import.c:65:import_set_state_nolock()) ffff9e3e0341e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783138023.409606:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783138023.409610:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f881880 x1869755175905024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138025 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409617:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f880a80 x1869755175905280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138028 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409625:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f883480 x1869755175905536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138032 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409633:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f3f48dc00 x1869755175905664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138037 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409640:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f883b80 x1869755175905920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138038 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409648:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f880700 x1869755175906048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783138033 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138023.409654:0:21356:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783138023.409661:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1783138023.409783:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869755175905536:0@lo:400:kworker.0 00000100:00100000:2.0:1783138023.409786:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869755175905664:0@lo:400:kworker.0 00000100:00100000:1.0:1783138023.409854:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869755175905920:0@lo:400:kworker.0 00000100:00100000:3.0:1783138023.409917:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1869755175905280:0@lo:400:kworker.0 00000100:00100000:2.0:1783138023.414547:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869755175905024:0@lo:400:kworker.0 00000100:00100000:2.0:1783138023.414849:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1869755175906048:0@lo:38:kworker.0 00010000:00010000:0.0:1783138023.420856:0:21356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8e00/0x50a9699713c4c697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c69e expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.420878:0:21356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8e00/0x50a9699713c4c697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c69e expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.420885:0:21356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8e00/0x50a9699713c4c697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c69e expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.420891:0:21356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8e00/0x50a9699713c4c697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c69e expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.420919:0:21356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138023.420928:0:21356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a400/0x50a9699713c4c881 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4c888 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.420935:0:21356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a400/0x50a9699713c4c881 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4c888 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.420942:0:21356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a400/0x50a9699713c4c881 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c888 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.420950:0:21356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a400/0x50a9699713c4c881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x50a9699713c4c888 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138023.421033:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138023.421040:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8e00/0x50a9699713c4c697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c69e expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138023.421049:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8e00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:1.0:1783138023.421053:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8e00/0x50a9699713c4c697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c69e expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138023.421062:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8e00/0x50a9699713c4c697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c69e expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138023.421069:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8e00/0x50a9699713c4c697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c69e expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138023.421074:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783138023.421076:0:17169:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1783138023.421086:0:17169:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e3e043a0800 00010000:00010000:1.0:1783138023.421089:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8e00/0x50a9699713c4c697 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c69e expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138023.421107:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e028b8e00/0x50a9699713c4c697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c69e expref: -99 pid: 19498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138023.421120:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138023.421124:0:17169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a400/0x50a9699713c4c881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c888 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.421125:0:21356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1783138023.421135:0:21356:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1783138023.421136:0:17169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f0151a400 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:1.0:1783138023.421141:0:17169:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a400/0x50a9699713c4c881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x50a9699713c4c888 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138023.421141:0:21356:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1783138023.421152:0:17169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a400/0x50a9699713c4c881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c888 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138023.421159:0:17169:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a400/0x50a9699713c4c881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c888 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138023.421164:0:17169:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783138023.421167:0:17169:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000020:01000004:0.0:1783138023.421168:0:21356:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 10000000:01000000:1.0:1783138023.421170:0:17169:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000000:0.0:1783138023.421173:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:1.0:1783138023.421179:0:17169:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e3e043a0800 00010000:00010000:1.0:1783138023.421184:0:17169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a400/0x50a9699713c4c881 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c888 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783138023.421184:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138023.421192:0:21356:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:1.0:1783138023.421194:0:17169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f0151a400/0x50a9699713c4c881 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c888 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783138023.421197:0:21356:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9e3f0445b380) has no exports 00010000:00010000:1.0:1783138023.421212:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138023.421215:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138023.421226:0:17169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783138023.421241:0:21356:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9e3f0445b380) has no exports 00010000:00010000:2.0:1783138023.423178:0:17168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783138023.423298:0:21356:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e3e01f92000 - data ffff9e3f1fd4f870/ffff9e3f045b5400 00000020:01000000:1.0:1783138023.423503:0:21356:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e3e02887f60 - data ffff9e3f1ff6e438/ffff9e3e0388b800 00100000:10000000:1.0:1783138023.435866:0:21356:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1783138023.443363:0:21356:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c6ac 00000020:00000080:0.0:1783138023.443377:0:21356:0:(genops.c:906:class_export_put()) final put ffff9e3e01f81000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1783138023.443391:0:21356:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e3e03905800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1783138023.443396:0:21356:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3e03905800 2 00000020:00000080:2.0:1783138023.443400:0:16974:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e01f81000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:0.0:1783138023.443400:0:21356:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e3e03905800 from lustre-OST0001 00000020:00000080:0.0:1783138023.443431:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138023.443442:0:21356:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1783138023.443446:0:21356:0:(genops.c:906:class_export_put()) final put ffff9e3e01f81800/lustre-OST0001_UUID 00000020:00000080:0.0:1783138023.443449:0:21356:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e01f81800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1783138023.443459:0:21356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1783138023.443548:0:21356:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import e1bc6deb-b70a-4cda-b653-fb67e3bea6e4->MGS 00010000:00010000:0.0:1783138023.443563:0:21356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f36321e00/0x50a9699713c4c3f7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c3fe expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138023.443575:0:21356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f36321e00/0x50a9699713c4c3f7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c3fe expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138023.443581:0:21356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1783138023.443585:0:21356:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1783138023.443588:0:21356:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1783138023.443602:0:21356:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e3e043a0800 00010000:00010000:0.0:1783138023.443607:0:21356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f36321e00/0x50a9699713c4c3f7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c3fe expref: -99 pid: 17911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138023.443622:0:21356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9400/0x50a9699713c4c2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x50a9699713c4c2ed expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138023.443639:0:21356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9400/0x50a9699713c4c2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x50a9699713c4c2ed expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138023.443645:0:21356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783138023.443647:0:21356:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1783138023.443649:0:21356:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1783138023.443658:0:21356:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e3e043a0800 00010000:00010000:0.0:1783138023.443661:0:21356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e028b9400/0x50a9699713c4c2e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x50a9699713c4c2ed expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783138023.443896:0:21356:0:(import.c:65:import_set_state_nolock()) ffff9e3e043a0800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1783138023.443902:0:21356:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783138023.443904:0:21356:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783138023.443906:0:21356:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783138023.444036:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783138023.444048:0:21356:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e3f2f882680 x1869755175905408/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783138031 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783138023.444069:0:21356:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783138023.444072:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:2.0:1783138023.444391:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e1bc6deb-b70a-4cda-b653-fb67e3bea6e4:3657:1869755175905408:0@lo:250:kworker.0 10000000:01000000:3.0:1783138023.444465:0:21356:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783138023.444473:0:21356:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c2d1 00000020:00000080:3.0:1783138023.444478:0:21356:0:(genops.c:906:class_export_put()) final put ffff9e3e043a1000/e1bc6deb-b70a-4cda-b653-fb67e3bea6e4 00000020:01000000:3.0:1783138023.444492:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.143@tcp (flags='') 00000020:00000080:3.0:1783138023.444497:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138023.444503:0:21356:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.143@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783138023.444506:0:21356:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9e3e027119c0) has no exports 10000000:01000000:2.0:1783138023.444548:0:17177:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1783138023.444599:0:16974:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e043a1000/e1bc6deb-b70a-4cda-b653-fb67e3bea6e4 for MGC192.168.203.143@tcp 10000000:01000000:3.0:1783138023.444641:0:21356:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.143@tcp: client import never connected 00000100:00080000:3.0:1783138023.444644:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1783138023.444646:0:21356:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783138023.444649:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1783138023.444651:0:21356:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783138023.444686:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783138023.444690:0:21356:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.143@tcp (uuid e1bc6deb-b70a-4cda-b653-fb67e3bea6e4) 00000020:01000000:3.0:1783138023.444705:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783138023.444708:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783138023.444712:0:21356:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783138023.444717:0:21356:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e3e0341f800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783138023.444722:0:21356:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff9e3f3411cd40) has exports, disconnecting them 00000020:00080000:3.0:1783138023.444727:0:21356:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e3e0341f800), last request at 1783137951 00000020:00000080:3.0:1783138023.444730:0:21356:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c6d6 00000020:00080000:3.0:1783138023.444740:0:21356:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3e0341f800): rc 0 00000020:00000080:3.0:1783138023.444744:0:21356:0:(genops.c:906:class_export_put()) final put ffff9e3e0341f800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783138023.445037:0:16974:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e043a0800 for MGC192.168.203.143@tcp 00000020:00000080:2.0:1783138023.445043:0:16974:0:(genops.c:906:class_export_put()) final put ffff9e3e043a2000/e1bc6deb-b70a-4cda-b653-fb67e3bea6e4 00000020:00000080:2.0:1783138023.445045:0:16974:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e043a2000/e1bc6deb-b70a-4cda-b653-fb67e3bea6e4 for MGC192.168.203.143@tcp 00000020:01000000:2.0:1783138023.445050:0:16974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.143@tcp (e1bc6deb-b70a-4cda-b653-fb67e3bea6e4) 00000020:00000080:2.0:1783138023.445276:0:16974:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0341f800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783138023.448674:0:21356:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783138023.448682:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783138023.448686:0:21356:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783138023.448693:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783138023.448844:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783138023.448853:0:21356:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1783138023.448862:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783138023.448876:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783138023.448881:0:21356:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783138023.448888:0:21356:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9e3e03419800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783138023.448895:0:21356:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9e3f3411b380) has exports, disconnecting them 00000020:00080000:2.0:1783138023.448899:0:21356:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9e3e03419800), last request at 1783137951 00000020:00000080:2.0:1783138023.448902:0:21356:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c6eb 00000020:00080000:2.0:1783138023.448920:0:21356:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e3e03419800): rc 0 00000020:00000080:2.0:1783138023.448925:0:21356:0:(genops.c:906:class_export_put()) final put ffff9e3e03419800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1783138023.449847:0:16974:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e0341a800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783138023.449861:0:16974:0:(genops.c:906:class_export_put()) final put ffff9e3e0341b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1783138023.449864:0:16974:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0341b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1783138023.449870:0:16974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1783138023.449933:0:16974:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e03419800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1783138023.454422:0:21356:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1783138023.454432:0:21356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783138023.454437:0:21356:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783138023.454445:0:21356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783138023.454498:0:16974:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e3e0341e000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1783138023.546180:0:19710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1783138023.554066:0:17169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1783138023.555874:0:17168:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1783138023.566845:0:17163:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e3f34105c00:17163] 0 exiting: rc = 1 00000100:00100000:2.0:1783138023.567451:0:17164:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e3e035c1400:17164] 1 exiting: rc = 0 00000100:00100000:0.0:1783138023.567504:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.567935:0:17166:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e3f34104200:17166] 1 exiting: rc = 0 00000100:00100000:0.0:1783138023.568083:0:17167:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e3f340f3800:17167] 2 exiting: rc = 0 00000100:00100000:1.0:1783138023.570446:0:20952:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e3f2b208c00:20952] 3 exiting: rc = 0 00000100:00100000:2.0:1783138023.571680:0:17165:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e3f34104800:17165] 0 exiting: rc = 1 00000100:00100000:0.0:1783138023.574071:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574286:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574294:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574303:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574310:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574337:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574343:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574381:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574386:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574391:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574396:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574401:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574407:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574412:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574418:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574423:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574429:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574434:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574439:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574445:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574450:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574469:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574477:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574482:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574488:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574494:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574499:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574504:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574510:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574515:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574537:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.574543:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575454:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575464:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575469:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575474:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575479:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575484:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575489:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575493:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575497:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575502:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575506:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575511:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575516:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575521:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575526:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575532:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575536:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575541:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.575546:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576061:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576069:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576074:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576079:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576085:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576090:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576095:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576101:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576107:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576113:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576118:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576124:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783138023.576130:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783138023.578310:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138023.578349:0:21356:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1783138023.578355:0:21356:0:(genops.c:906:class_export_put()) final put ffff9e3e0341b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1783138023.578360:0:21356:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0341b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1783138023.578365:0:21356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1783138023.578421:0:21356:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3e03905800 1 00000020:00000080:0.0:1783138023.578427:0:21356:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x50a9699713c4c690 00000020:00000080:0.0:1783138023.578433:0:21356:0:(genops.c:906:class_export_put()) final put ffff9e3e039b9000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1783138023.578448:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1783138023.578453:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138023.578457:0:21356:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783138023.578460:0:21356:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff9e3f1f9f0000) has no exports 00000020:00000080:3.0:1783138023.578623:0:16974:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e039b9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1783138023.631059:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138023.631074:0:21356:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1783138023.631080:0:21356:0:(genops.c:906:class_export_put()) final put ffff9e3e03902800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1783138023.631084:0:21356:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e03902800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1783138023.631094:0:21356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1783138023.634423:0:21356:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9e3e03904000 00000020:01000000:0.0:1783138023.634453:0:21356:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1783138023.634460:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783138023.634467:0:21356:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783138023.634472:0:21356:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9e3f1f9f4d40) has no exports 00000020:00000080:0.0:1783138023.634515:0:21356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783138023.634528:0:21356:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1783138023.634532:0:21356:0:(genops.c:906:class_export_put()) final put ffff9e3e0257c800/OSS_uuid 00000020:00000080:0.0:1783138023.634536:0:21356:0:(genops.c:865:class_export_destroy()) destroying export ffff9e3e0257c800/OSS_uuid for OSS 00000020:01000000:0.0:1783138023.634541:0:21356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1783138023.636803:0:17176:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1783138023.637511:0:18684:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e3e035c1000:18684] 0 exiting: rc = 1 00000100:00100000:3.0:1783138023.637644:0:18686:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e3f125a7000:18686] 1 exiting: rc = 0 00000100:00100000:2.0:1783138023.638682:0:19078:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e3e02867800:19078] 3 exiting: rc = 0 00000100:00100000:2.0:1783138023.638774:0:18687:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e3f2b180e00:18687] 2 exiting: rc = 0 00000100:00100000:1.0:1783138023.638953:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.638963:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.638968:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.638974:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.638978:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.638983:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.638988:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.638994:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.638999:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639004:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639009:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639019:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639024:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639029:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639033:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639037:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639042:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639046:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639051:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639057:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639062:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639067:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639071:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639076:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639082:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639087:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639092:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639098:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639119:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639124:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639129:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639134:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639152:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639158:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639163:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639168:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639172:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639177:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639182:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639187:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639192:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639197:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639210:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639215:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639220:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639225:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639230:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639234:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639240:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639244:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639249:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639255:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639259:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639263:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639268:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639273:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639279:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639284:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639289:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639294:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639299:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639304:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639310:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.639351:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138023.640747:0:18689:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e3f3f8ace00:18689] 1 exiting: rc = 0 00000100:00100000:0.0:1783138023.642534:0:18688:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e3f343a7400:18688] 0 exiting: rc = 1 00000100:00100000:1.0:1783138023.642663:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642672:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642678:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642684:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642689:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642695:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642700:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642705:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642710:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642716:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642721:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642725:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642730:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642736:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642741:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642746:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642752:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642757:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642762:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642768:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642774:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642779:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642784:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642802:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642814:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642821:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642826:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642831:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642845:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642850:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642855:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642859:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642865:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642870:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642890:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642895:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642900:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642905:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642909:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642913:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642918:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642923:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642928:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642933:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642937:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642943:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642948:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642953:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642958:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642963:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642968:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642973:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642978:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642982:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642987:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642991:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.642996:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.643002:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.643006:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.643011:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.643015:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.643020:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.643025:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.643030:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783138023.648911:0:18690:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e3f3629b000:18690] 0 exiting: rc = 1 00000100:00100000:0.0:1783138023.649848:0:18691:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e3f35f30400:18691] 1 exiting: rc = 0 00000100:00100000:3.0:1783138023.652192:0:18692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e3f35f31800:18692] 2 exiting: rc = 0 00000100:00100000:1.0:1783138023.654917:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.654928:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.654936:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.654943:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.654949:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.654979:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.654989:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.654995:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655003:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655010:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655016:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655021:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655030:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655036:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655175:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655183:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655189:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655195:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655199:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655205:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655210:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655220:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655226:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655232:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655237:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655243:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655248:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655253:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655259:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655264:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655269:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655275:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655280:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655285:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655290:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655296:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655302:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655309:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655412:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655551:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655565:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655570:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655576:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655581:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655586:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655591:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655596:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655602:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655607:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655612:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655627:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655632:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655638:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655644:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655649:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655655:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655660:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655674:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655686:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655692:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655697:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655703:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655709:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.655715:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138023.660720:0:18693:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e3f35f31400:18693] 0 exiting: rc = 1 00000100:00100000:2.0:1783138023.664933:0:18694:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e3f043bd800:18694] 1 exiting: rc = 0 00000100:00100000:1.0:1783138023.666986:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.666995:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667000:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667005:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667011:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667016:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667034:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667041:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667047:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667052:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667058:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667076:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667081:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667085:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667091:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667095:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667103:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667110:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667118:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667124:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667129:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667133:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667138:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667143:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667147:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667151:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667156:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667160:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667164:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667170:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667175:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667179:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667183:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667188:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667192:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667198:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667202:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667206:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667211:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667216:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667221:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667226:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667230:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667236:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667241:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667245:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667258:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667263:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667268:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667273:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667277:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667282:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667287:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667292:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667297:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667302:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667307:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667346:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667355:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667360:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667364:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667369:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667374:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.667693:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783138023.668770:0:18696:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e3f2b0c6200:18696] 1 exiting: rc = 0 00000100:00100000:2.0:1783138023.668954:0:18695:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e3f2b0c6400:18695] 0 exiting: rc = 1 00000100:00100000:1.0:1783138023.673748:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673759:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673774:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673782:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673798:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673805:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673813:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673821:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673828:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673836:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673844:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673864:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673871:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673876:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673882:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673888:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673894:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673914:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673920:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673926:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673933:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673939:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673944:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673964:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673972:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673978:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673984:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673990:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.673996:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674002:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674008:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674014:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674020:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674025:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674032:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674055:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674062:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674068:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674074:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674080:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674086:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674092:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674098:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674105:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674111:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674117:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674124:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674144:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674152:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674158:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674164:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674170:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674184:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674190:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674197:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674204:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674209:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674215:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674221:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674241:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674247:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674253:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674260:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783138023.674267:0:21356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783138023.692073:0:21356:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1783138045.383983:0:22121:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783138056.855272:0:22721:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783138056.855278:0:22721:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1783138056.855279:0:22721:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783138056.855615:0:22721:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e3f3625b800 00000020:01000004:3.0:1783138056.855649:0:22721:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783138056.855657:0:22721:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783138056.855680:0:22721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e3f1f9f3380) 00000020:00000080:3.0:1783138056.855695:0:22721:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783138056.943444:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783138056.944459:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783138056.945809:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1783138056.950049:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1783138056.950706:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1783138056.951034:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783138056.951564:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1783138056.952077:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1783138056.952250:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1783138056.953051:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1783138056.953797:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1783138056.954134:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783138056.955286:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1783138056.956170:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1783138056.956471:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783138056.957396:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.958084:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.958344:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.958609:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.959046:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.959446:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.959820:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.960169:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.960442:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.960762:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.961139:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.961384:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.962239:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.963039:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.963254:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.963610:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.964220:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.964821:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.965767:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.966076:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.966879:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.967199:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.967889:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.968177:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.968553:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.968860:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.969176:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1783138056.970869:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.971469:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.972153:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.973733:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.974212:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1783138056.979655:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1783138056.980460:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1783138056.980800:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1783138056.983518:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1783138056.992532:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1783138056.993491:0:22721:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:0.0:1783138056.994735:0:22721:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783138056.995167:0:22721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783138056.995176:0:22721:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783138056.995188:0:22721:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50a9699713c4cb44 00000020:01000004:0.0:1783138056.995195:0:22721:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783138056.995200:0:22721:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783138056.995205:0:22721:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e3f3625b800 from MGS 00000020:01000004:0.0:1783138056.995209:0:22721:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783138056.995218:0:22721:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e3f2b083380) 00000020:00000080:0.0:1783138056.995228:0:22721:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783138056.995288:0:22721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e3f3625b800 from MGS, refs=2 00080000:01000000:0.0:1783138056.995293:0:22721:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783138056.995298:0:22721:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50a9699713c4cb52 00000100:00100000:0.0:1783138056.995499:0:22721:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783138056.995678:0:22721:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783138056.995685:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783138056.996980:0:22721:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783138056.996990:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783138056.997969:0:22721:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783138056.998124:0:22721:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783138056.998129:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783138056.999264:0:22721:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783138056.999276:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783138056.999828:0:22721:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783138056.999845:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783138057.001174:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138057.001178:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138057.001181:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138057.002155:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138057.002158:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138057.002161:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138057.002983:0:22721:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1783138057.004929:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1783138057.013787:0:22721:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1783138057.018092:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783138057.021022:0:22721:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783138057.021075:0:22721:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783138057.023655:0:22721:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783138057.023974:0:22721:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783138057.024140:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783138057.024147:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783138057.025265:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783138057.025275:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783138057.025730:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783138057.025737:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783138057.039436:0:22721:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783138057.039461:0:22721:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.143@tcp' 00000020:01000004:2.0:1783138057.039463:0:22721:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783138057.039495:0:22721:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.143@tcp (typ=mgc) 00000020:00000080:2.0:1783138057.039508:0:22721:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.143@tcp (ffff9e3f0445cd40) 00000020:00000080:2.0:1783138057.039523:0:22721:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783138057.039614:0:22721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3e0264b000@MGC192.168.203.143@tcp: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1783138057.040040:0:22721:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.143@tcp-0 is initialized 00000040:01000000:2.0:1783138057.040047:0:22721:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 1 is initialized 10000000:01000000:2.0:1783138057.042030:0:22739:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783138057.042110:0:22721:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.143@tcp (uuid ff132a53-abfa-4987-a345-1706880f10ac) 00000020:00000080:3.0:1783138057.042132:0:22721:0:(genops.c:1406:class_connect()) connect: client ff132a53-abfa-4987-a345-1706880f10ac, cookie 0x50a9699713c4cb60 00000100:00080000:3.0:1783138057.042144:0:22721:0:(import.c:512:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783138057.042150:0:22721:0:(import.c:626:import_select_connection()) MGC192.168.203.143@tcp: import ffff9e3e0264b000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1783138057.042184:0:22721:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2a986a00 x1869755175906176/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138057.042214:0:22721:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import ff132a53-abfa-4987-a345-1706880f10ac->MGS 00000020:01000004:3.0:1783138057.042236:0:22721:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783138057.042259:0:22721:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783138057.042273:0:22721:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e3f1f9f4d40) 00000020:00000080:3.0:1783138057.042286:0:22721:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783138057.042798:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ff132a53-abfa-4987-a345-1706880f10ac:3657:1869755175906176:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783138057.042999:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.043079:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175906176 00000100:00100000:2.0:1783138057.043090:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175906176 00000100:00100000:2.0:1783138057.043121:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138057.043127:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0285c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3657:x1869755175906176:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783138057.043151:0:22735:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from ff132a53-abfa-4987-a345-1706880f10ac@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:2.0:1783138057.043172:0:22735:0:(genops.c:1406:class_connect()) connect: client ff132a53-abfa-4987-a345-1706880f10ac, cookie 0x50a9699713c4cb6e 00000100:00080000:2.0:1783138057.043292:0:22735:0:(import.c:65:import_set_state_nolock()) ffff9e3e02649800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138057.043362:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0285c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+5:3657:x1869755175906176:12345-0@lo:250:mount.lustre.0 Request processed in 232us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138057.043369:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138057.043411:0:3657:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1783138057.043419:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.143@tcp: connect to target with instance 0 00000100:00080000:2.0:1783138057.044756:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783138057.044765:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783138057.044770:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e0264b000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783138057.044773:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783138057.044785:0:3657:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783138057.044792:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ff132a53-abfa-4987-a345-1706880f10ac:3657:1869755175906176:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1783138057.045739:0:22738:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1783138057.062706:0:22721:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783138057.064102:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783138057.064109:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783138057.066362:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783138057.066379:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783138057.067105:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783138057.067112:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783138057.069110:0:22721:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783138057.069308:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783138057.071058:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783138057.071982:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783138057.071991:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1783138057.115038:0:22721:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783138057.115233:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1783138057.115241:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783138057.116576:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783138057.116587:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783138057.117644:0:22721:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783138057.117946:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783138057.117960:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783138057.118526:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783138057.118534:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783138057.119142:0:22721:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783138057.119286:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783138057.119291:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783138057.120003:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783138057.120011:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1783138057.120682:0:22721:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783138057.120989:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783138057.120995:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783138057.121577:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783138057.121585:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783138057.142597:0:22721:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783138057.143185:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783138057.143193:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783138057.144502:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783138057.144517:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783138057.145392:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783138057.145401:0:22721:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783138057.146502:0:22721:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783138057.146534:0:22721:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783138057.146549:0:22721:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783138057.146657:0:22721:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783138057.146702:0:22721:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783138057.146707:0:22721:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783138057.146709:0:22721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783138057.146710:0:22721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138057.146711:0:22721:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138057.146712:0:22721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138057.146791:0:22721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138057.146793:0:22721:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138057.146794:0:22721:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783138057.146796:0:22721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138057.146797:0:22721:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783138057.146800:0:22721:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783138057.146803:0:22721:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783138057.146804:0:22721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783138057.146805:0:22721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138057.146807:0:22721:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138057.146808:0:22721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138057.146809:0:22721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138057.146810:0:22721:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138057.146811:0:22721:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783138057.146811:0:22721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138057.146812:0:22721:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783138057.146841:0:22721:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783138057.146939:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906304:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783138057.147017:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138057.147090:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f362a4540 going to sleep for 11 seconds 00000100:00100000:3.0:1783138057.147154:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175906304 00000100:00100000:3.0:1783138057.147161:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175906304 00000100:00100000:3.0:1783138057.147259:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783138057.147269:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0285f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+5:22721:x1869755175906304:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783138057.147348:0:22737:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783138057.147352:0:22737:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783138057.147356:0:22737:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1783138057.147660:0:22758:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1783138057.148743:0:22737:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1783138057.152908:0:22759:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783138057.152917:0:22759:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1783138057.152921:0:22759:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783138057.152924:0:22759:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783138057.153121:0:22759:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1783138057.153585:0:22737:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783138057.153601:0:22737:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783138057.155356:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0285f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+5:22721:x1869755175906304:12345-0@lo:253:mount.lustre.0 Request processed in 8080us (8330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138057.155377:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783138057.155578:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906304:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783138057.155595:0:22721:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783138057.155611:0:22721:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783138057.155613:0:22721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783138057.155614:0:22721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138057.155616:0:22721:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138057.155617:0:22721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138057.155619:0:22721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138057.155620:0:22721:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138057.155622:0:22721:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783138057.155624:0:22721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138057.155625:0:22721:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783138057.155653:0:22721:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e3f3625b800 from lustre-MDT0000 10000000:01000000:1.0:1783138057.155688:0:22721:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783138057.155691:0:22721:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783138057.155696:0:22721:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e3f0445cd40 10000000:01000000:1.0:1783138057.155701:0:22721:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783138057.155710:0:22721:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9e3f0445cd40 from 1 10000000:01000000:1.0:1783138057.155712:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783138057.155755:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138057.155766:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138057.155776:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138057.155797:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138057.155833:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138057.155870:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f362a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1783138057.155936:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175906432 00000100:00100000:2.0:1783138057.155942:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175906432 00000100:00100000:2.0:1783138057.156020:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138057.156030:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0285dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+5:22721:x1869755175906432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138057.156045:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138057.156141:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f3f479000/0x50a9699713c4cb7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cb75 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.156168:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f3f479000/0x50a9699713c4cb7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cb75 expref: 6 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.156178:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f3f479000/0x50a9699713c4cb7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cb75 expref: 6 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.156188:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f3f479000, rc 0) 00000100:00100000:2.0:1783138057.156263:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0285dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+6:22721:x1869755175906432:12345-0@lo:101:mount.lustre.0 Request processed in 234us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138057.156270:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138057.156384:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138057.156398:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138057.156418:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138057.156559:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138057.156589:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138057.156662:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f362a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1783138057.156705:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175906560 00000100:00100000:0.0:1783138057.156710:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175906560 00000100:00100000:0.0:1783138057.156774:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783138057.156782:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f03ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+6:22721:x1869755175906560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138057.156904:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f03ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+6:22721:x1869755175906560:12345-0@lo:501:mount.lustre.0 Request processed in 124us (313us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783138057.156925:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138057.156972:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906560:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783138057.157003:0:22721:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783138057.157024:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.157032:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138057.157040:0:22721:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e3f3625b800 10000000:01000000:2.0:1783138057.157045:0:22721:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783138057.157049:0:22721:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e3f3625b800 10000000:01000000:2.0:1783138057.157051:0:22721:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783138057.157054:0:22721:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9e3f3625b800 from 1 10000000:01000000:2.0:1783138057.157056:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783138057.157207:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478200/0x50a9699713c4cb83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.157225:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478200/0x50a9699713c4cb83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.157233:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478200/0x50a9699713c4cb83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138057.157249:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138057.157275:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.157296:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f07c3f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138057.157381:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175906688 00000100:00100000:3.0:1783138057.157386:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175906688 00000100:00100000:3.0:1783138057.157411:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783138057.157418:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+6:22721:x1869755175906688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138057.157434:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138057.157448:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f00030000/0x50a9699713c4cb8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cb83 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138057.157473:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f00030000/0x50a9699713c4cb8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cb83 expref: 7 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138057.157480:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f00030000/0x50a9699713c4cb8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cb83 expref: 7 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138057.157488:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f00030000, rc 0) 00000100:00100000:3.0:1783138057.157525:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+7:22721:x1869755175906688:12345-0@lo:101:mount.lustre.0 Request processed in 108us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138057.157530:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138057.157705:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138057.157717:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478200/0x50a9699713c4cb83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb8a expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.157725:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478200/0x50a9699713c4cb83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cb8a expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138057.157738:0:22721:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783138057.157753:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478200/0x50a9699713c4cb83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb8a expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.157759:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478200/0x50a9699713c4cb83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb8a expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138057.157766:0:22721:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783138057.157769:0:22721:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783138057.157774:0:22721:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e3f3625b800 10000000:01000000:2.0:1783138057.157777:0:22721:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783138057.157785:0:22721:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783138057.157788:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783138057.157803:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478600/0x50a9699713c4cb91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.157810:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478600/0x50a9699713c4cb91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.157817:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478600/0x50a9699713c4cb91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138057.157831:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138057.157857:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.157876:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f07c3f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138057.157925:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175906816 00000100:00100000:3.0:1783138057.157929:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175906816 00000100:00100000:3.0:1783138057.157960:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138057.157966:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+7:22721:x1869755175906816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138057.157974:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138057.157981:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f00030400/0x50a9699713c4cb98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cb91 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138057.157994:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f00030400/0x50a9699713c4cb98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cb91 expref: 8 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138057.158002:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f00030400/0x50a9699713c4cb98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cb91 expref: 8 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138057.158008:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f00030400, rc 0) 00000100:00100000:3.0:1783138057.158204:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+8:22721:x1869755175906816:12345-0@lo:101:mount.lustre.0 Request processed in 237us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138057.158210:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783138057.158306:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138057.158565:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478600/0x50a9699713c4cb91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb98 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.158575:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478600/0x50a9699713c4cb91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cb98 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138057.158711:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a984a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138057.158740:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138057.158810:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2aed0900 going to sleep for 11 seconds 00000100:00100000:1.0:1783138057.158848:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175906944 00000100:00100000:1.0:1783138057.158852:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175906944 00000100:00100000:1.0:1783138057.158912:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783138057.158918:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+8:22721:x1869755175906944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138057.159083:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+9:22721:x1869755175906944:12345-0@lo:501:mount.lustre.0 Request processed in 165us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138057.159090:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138057.159156:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a984a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175906944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138057.159190:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175907072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138057.159232:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.159466:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f07f10900 going to sleep for 11 seconds 00000100:00100000:3.0:1783138057.159502:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175907072 00000100:00100000:3.0:1783138057.159507:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175907072 00000100:00100000:3.0:1783138057.159529:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783138057.159535:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+9:22721:x1869755175907072:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138057.160258:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+9:22721:x1869755175907072:12345-0@lo:503:mount.lustre.0 Request processed in 719us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138057.160267:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783138057.160380:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175907072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138057.160772:0:22760:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22760:1869755175907200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138057.160817:0:22760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.160851:0:22760:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f07c3ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1783138057.160893:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175907200 00000100:00100000:3.0:1783138057.160897:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175907200 00000100:00100000:3.0:1783138057.160921:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783138057.160927:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+9:22760:x1869755175907200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783138057.161572:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+9:22760:x1869755175907200:12345-0@lo:502:llog_process_th.0 Request processed in 643us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138057.161581:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138057.161684:0:22760:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22760:1869755175907200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783138057.161711:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138057.161728:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138057.161730:0:22760:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783138057.161736:0:22760:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783138057.161739:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783138057.161753:0:22760:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e3f044599c0) 00000020:00000080:2.0:1783138057.161770:0:22760:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783138057.161775:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783138057.161868:0:22760:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783138057.161876:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50a9699713c4cba6 00000020:00000080:2.0:1783138057.162263:0:22760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783138057.162269:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138057.162272:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138057.162274:0:22760:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783138057.162276:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138057.162280:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138057.162282:0:22760:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783138057.162285:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783138057.162294:0:22760:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e3f0445b380) 00000020:00000080:2.0:1783138057.162304:0:22760:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783138057.162308:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783138057.162310:0:22760:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783138057.162422:0:22760:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783138057.162684:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783138057.162752:0:22760:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e3f3625b800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783138057.162765:0:22760:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e3f34118000) 00000020:00000080:1.0:1783138057.162774:0:22760:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783138057.162829:0:22760:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783138057.162835:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50a9699713c4cbbb 00000020:00000080:1.0:1783138057.162939:0:22760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783138057.162946:0:22760:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783138057.162951:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x50a9699713c4cbc2 00080000:01000000:1.0:1783138057.162956:0:22760:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783138057.162960:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50a9699713c4cbc9 00010000:00010000:1.0:1783138057.235148:0:22760:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1783138057.235790:0:22760:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1783138057.236099:0:22760:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783138057.236615:0:22760:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e3f341199c0) 00000020:00000080:1.0:1783138057.236649:0:22760:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1783138057.236728:0:22760:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783138057.236737:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50a9699713c4cbd7 00000020:00000080:1.0:1783138057.237286:0:22760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783138057.241146:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x50a9699713c4cbde 00000020:00000080:1.0:1783138057.241551:0:22760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783138057.241562:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138057.241567:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138057.241569:0:22760:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783138057.241573:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783138057.241575:0:22760:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1783138057.241577:0:22760:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783138057.241579:0:22760:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783138057.241580:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783138057.241583:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138057.241584:0:22760:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783138057.241587:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783138057.241592:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138057.241593:0:22760:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783138057.241598:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783138057.241697:0:22760:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783138057.241715:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138057.241718:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138057.241720:0:22760:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783138057.241723:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783138057.241726:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138057.241727:0:22760:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783138057.241730:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783138057.241735:0:22760:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:00000080:1.0:1783138057.241758:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783138057.241772:0:22760:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9e3f3411b380) 00000020:00000080:1.0:1783138057.241785:0:22760:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1783138057.241789:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783138057.241844:0:22760:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783138057.241849:0:22760:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783138057.241855:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50a9699713c4cbec 00010000:00080000:1.0:1783138057.241885:0:22760:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3e0413b000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1783138057.245577:0:22760:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1783138057.251450:0:22760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783138057.251471:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783138057.251517:0:22760:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783138057.251547:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50a9699713c4cbf3 00000100:00080000:0.0:1783138057.251558:0:22760:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783138057.251564:0:22760:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e3e0413b000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138057.251601:0:22760:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e03b02a00 x1869755175907328/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138057.251623:0:22760:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783138057.251751:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175907328:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783138057.251836:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783138057.252075:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138057.252079:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138057.252081:0:22760:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1783138057.252084:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783138057.252087:0:22760:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1783138057.252089:0:22760:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783138057.252091:0:22760:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783138057.252092:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783138057.252095:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138057.252097:0:22760:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783138057.252099:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783138057.252105:0:22760:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783138057.252109:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138057.252110:0:22760:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783138057.252122:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783138057.252126:0:22760:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:0.0:1783138057.252152:0:22760:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783138057.252155:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783138057.252171:0:22760:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e3f2b0819c0) 00000020:00000080:0.0:1783138057.252186:0:22760:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1783138057.252191:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783138057.252270:0:22760:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783138057.252278:0:22760:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783138057.252284:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50a9699713c4cc01 00010000:00080000:0.0:1783138057.252343:0:22760:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3e038b4800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1783138057.252628:0:22760:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1783138057.253240:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175907328 00000100:00100000:1.0:1783138057.253250:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175907328 00000100:00100000:1.0:1783138057.253291:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783138057.253298:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1869755175907328:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1783138057.253332:0:22747:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1783138057.261824:0:22760:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783138057.262184:0:22760:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783138057.266071:0:22760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138057.266797:0:22760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1783138057.276281:0:22760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1783138057.277222:0:22766:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783138057.277229:0:22766:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1783138057.278118:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1869755175907328:12345-0@lo:38:llog_process_th.0 Request processed in 24811us (26275us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783138057.278139:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783138057.278684:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783138057.278692:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783138057.278696:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175907328:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1783138057.279552:0:22760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783138057.279569:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783138057.279612:0:22760:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783138057.279630:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50a9699713c4cc08 00000100:00080000:1.0:1783138057.279639:0:22760:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783138057.279644:0:22760:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e3e038b4800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1783138057.279676:0:22760:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2f883b80 x1869755175907456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783138057.279744:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175907456:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783138057.279790:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755175907456 offset 0 length 520: 4 00000100:00080000:1.0:1783138057.279833:0:22760:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783138057.279884:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138057.279888:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138057.279890:0:22760:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783138057.279892:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783138057.279895:0:22760:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1783138057.279896:0:22760:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783138057.279898:0:22760:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783138057.279907:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783138057.279910:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138057.279911:0:22760:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783138057.279913:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783138057.279917:0:22760:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783138057.279920:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138057.279921:0:22760:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783138057.279924:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783138057.279928:0:22760:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:1.0:1783138057.279947:0:22760:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783138057.279949:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783138057.279960:0:22760:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e3f3411cd40) 00000020:00000080:1.0:1783138057.279971:0:22760:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1783138057.279975:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783138057.280045:0:22760:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783138057.280051:0:22760:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783138057.280057:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x50a9699713c4cc16 00010000:00080000:1.0:1783138057.280085:0:22760:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3f1f987800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1783138057.280282:0:22760:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1783138057.280383:0:22760:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783138057.280400:0:22760:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:0.0:1783138057.280865:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783138057.280870:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783138057.280873:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138057.280878:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 718 00000100:00080000:0.0:1783138057.280882:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783138057.280886:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e3e0413b000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138057.280903:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e03b03100 x1869755175907712/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783138057.281014:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175907584:0@lo:400:kworker.0 00000100:00100000:1.0:1783138057.281067:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138057.281788:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175907584 00000100:00100000:3.0:1783138057.281796:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175907584 00000100:00100000:3.0:1783138057.281845:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783138057.282125:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+9:3658:x1869755175907584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138057.282213:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+9:3658:x1869755175907584:12345-0@lo:400:kworker.0 Request processed in 359us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138057.282221:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138057.282611:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175907712:0@lo:38:kworker.0 00000100:00100000:2.0:1783138057.282662:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.283134:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175907712 00000100:00100000:2.0:1783138057.283141:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175907712 00000100:00100000:2.0:1783138057.283164:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138057.283170:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1869755175907712:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783138057.283188:0:22748:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783138057.283225:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1869755175907712:12345-0@lo:38:kworker.0 Request processed in 55us (564us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783138057.283232:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783138057.283727:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175907584:0@lo:400:kworker.0 00000040:00080000:1.0:1783138057.284920:0:22760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783138057.285238:0:22760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1783138057.285411:0:22760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00080000:2.0:1783138057.286220:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138057.286228:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783138057.286233:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175907712:0@lo:38:kworker.0 00000040:00080000:2.0:1783138057.286626:0:22768:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1783138057.286631:0:22768:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783138057.287290:0:22760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783138057.287302:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783138057.287373:0:22760:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783138057.287392:0:22760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50a9699713c4cc1d 00000100:00080000:2.0:1783138057.287401:0:22760:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783138057.287407:0:22760:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e3f1f987800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138057.287534:0:22760:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f3f48df80 x1869755175907840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138057.287569:0:22760:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1783138057.287648:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175907840:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783138057.287701:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755175907840 offset 0 length 520: 4 00000020:01000000:2.0:1783138057.287797:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138057.287801:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138057.287803:0:22760:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783138057.287806:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138057.287820:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138057.287822:0:22760:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783138057.287825:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783138057.287827:0:22760:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783138057.287828:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138057.287831:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138057.287843:0:22760:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783138057.287846:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138057.287848:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138057.287850:0:22760:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783138057.287854:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783138057.287884:0:22760:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22760:1869755175907968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138057.287932:0:22760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.287954:0:22760:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f07c3f840 going to sleep for 11 seconds 00000100:00100000:0.0:1783138057.287997:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175907968 00000100:00100000:0.0:1783138057.288004:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175907968 00000100:00100000:0.0:1783138057.288057:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783138057.288066:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+9:22760:x1869755175907968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783138057.288175:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+9:22760:x1869755175907968:12345-0@lo:502:llog_process_th.0 Request processed in 110us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138057.288188:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783138057.288308:0:22760:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22760:1869755175907968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783138057.288360:0:22760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138057.288365:0:22760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138057.288367:0:22760:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783138057.288370:0:22760:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783138057.288593:0:22721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1783138057.288620:0:22721:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783138057.288643:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478600/0x50a9699713c4cb91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb98 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.288653:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478600/0x50a9699713c4cb91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb98 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138057.288661:0:22721:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9e3f3625b800 from 1 10000000:01000000:0.0:1783138057.288664:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783138057.288694:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.288703:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.288712:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138057.288727:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783138057.288755:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.288774:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0a2f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783138057.288890:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175908096 00000100:00100000:3.0:1783138057.288895:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175908096 00000100:00100000:3.0:1783138057.289111:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783138057.289121:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+9:22721:x1869755175908096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138057.289131:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138057.289145:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cc24 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138057.289165:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cc24 expref: 10 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138057.289175:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cc24 expref: 10 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138057.289184:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f00031000, rc 0) 00000100:00100000:3.0:1783138057.289216:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+10:22721:x1869755175908096:12345-0@lo:101:mount.lustre.0 Request processed in 98us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138057.289223:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783138057.289379:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138057.289392:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.289401:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138057.289988:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908224:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783138057.290032:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.290060:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0a2f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1783138057.290082:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175908224 00000100:00100000:0.0:1783138057.290087:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175908224 00000100:00100000:0.0:1783138057.290118:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138057.290126:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+10:22721:x1869755175908224:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783138057.290141:0:22737:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783138057.290147:0:22737:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783138057.290214:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+10:22721:x1869755175908224:12345-0@lo:256:mount.lustre.0 Request processed in 88us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138057.290221:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138057.290255:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908224:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783138057.290890:0:22721:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783138057.290904:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.290914:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138057.290923:0:22721:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9e3f3625b800 from 1 10000000:01000000:0.0:1783138057.290925:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783138057.290952:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.290960:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.291002:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138057.291020:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783138057.291056:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.291083:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0a2f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1783138057.291103:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175908352 00000100:00100000:0.0:1783138057.291108:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175908352 00000100:00100000:0.0:1783138057.291136:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783138057.291143:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+10:22721:x1869755175908352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138057.291152:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138057.291164:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e028fe600/0x50a9699713c4cc39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cc32 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.291185:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028fe600/0x50a9699713c4cc39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cc32 expref: 11 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.291194:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e028fe600/0x50a9699713c4cc39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cc32 expref: 11 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.291202:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028fe600, rc 0) 00000100:00100000:0.0:1783138057.291235:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+11:22721:x1869755175908352:12345-0@lo:101:mount.lustre.0 Request processed in 92us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138057.291241:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783138057.291276:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138057.291287:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.291302:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138057.291384:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138057.291409:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.291425:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0a2f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1783138057.291436:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175908480 00000100:00100000:0.0:1783138057.291439:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175908480 00000100:00100000:0.0:1783138057.291456:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783138057.291461:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+11:22721:x1869755175908480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138057.291593:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+11:22721:x1869755175908480:12345-0@lo:501:mount.lustre.0 Request processed in 130us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138057.291599:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783138057.291628:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138057.291656:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138057.291691:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.291703:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0a2f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1783138057.291715:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175908608 00000100:00100000:0.0:1783138057.291718:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175908608 00000100:00100000:0.0:1783138057.291734:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783138057.291740:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+11:22721:x1869755175908608:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138057.291821:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+11:22721:x1869755175908608:12345-0@lo:503:mount.lustre.0 Request processed in 80us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138057.291827:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783138057.291872:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138057.293898:0:22770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22770:1869755175908736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783138057.293968:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.294039:0:22770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e180c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138057.294096:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175908736 00000100:00100000:1.0:1783138057.294102:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175908736 00000100:00100000:1.0:1783138057.294170:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783138057.294178:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+11:22770:x1869755175908736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783138057.294724:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+11:22770:x1869755175908736:12345-0@lo:502:llog_process_th.0 Request processed in 545us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138057.294733:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783138057.294812:0:22770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22770:1869755175908736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783138057.294859:0:22770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138057.294869:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138057.294871:0:22770:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783138057.294879:0:22770:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e3f3625b800 00000020:00000080:0.0:1783138057.294881:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783138057.294891:0:22770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138057.294894:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138057.294895:0:22770:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783138057.294898:0:22770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138057.294900:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138057.294901:0:22770:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783138057.294904:0:22770:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e3f3625b800 00000020:00000080:0.0:1783138057.294906:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783138057.294959:0:22770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138057.294962:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138057.294964:0:22770:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783138057.294966:0:22770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138057.294969:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138057.294970:0:22770:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783138057.294973:0:22770:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e3f3625b800 00000020:00000080:0.0:1783138057.294975:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783138057.294990:0:22770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138057.294992:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138057.294994:0:22770:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783138057.294996:0:22770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138057.295004:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138057.295005:0:22770:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783138057.295008:0:22770:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e3f3625b800 00000020:00000080:0.0:1783138057.295010:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783138057.295044:0:22770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22770:1869755175908864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783138057.295077:0:22770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.299288:0:22770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e180c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783138057.302004:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175908864 00000100:00100000:2.0:1783138057.302024:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175908864 00000100:00100000:2.0:1783138057.302085:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783138057.302096:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+11:22770:x1869755175908864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138057.302262:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+11:22770:x1869755175908864:12345-0@lo:502:llog_process_th.0 Request processed in 166us (7183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138057.302271:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783138057.302353:0:22770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22770:1869755175908864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783138057.302391:0:22770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138057.302399:0:22770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138057.302406:0:22770:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783138057.302411:0:22770:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783138057.306570:0:22721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783138057.306612:0:22721:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783138057.306635:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.306649:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138057.306709:0:22721:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783138057.306712:0:22721:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e3f3625b800 10000000:01000000:0.0:1783138057.306715:0:22721:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e3f3625b800 10000000:01000000:0.0:1783138057.306719:0:22721:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783138057.306724:0:22721:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9e3f3625b800 from 1 10000000:01000000:0.0:1783138057.306727:0:22721:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783138057.306763:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff200/0x50a9699713c4cc40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.306773:0:22721:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff200/0x50a9699713c4cc40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.306784:0:22721:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff200/0x50a9699713c4cc40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138057.306808:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783138057.306935:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.306969:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e180c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138057.307028:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175908992 00000100:00100000:1.0:1783138057.307035:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175908992 00000100:00100000:1.0:1783138057.307075:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783138057.307085:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+11:22721:x1869755175908992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138057.307099:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138057.307113:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f341fe400/0x50a9699713c4cc47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cc40 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138057.307134:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f341fe400/0x50a9699713c4cc47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cc40 expref: 12 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138057.307144:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f341fe400/0x50a9699713c4cc47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cc40 expref: 12 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138057.307153:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f341fe400, rc 0) 00000100:00100000:1.0:1783138057.307201:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+12:22721:x1869755175908992:12345-0@lo:101:mount.lustre.0 Request processed in 116us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138057.307209:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783138057.308903:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175908992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138057.308933:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff200/0x50a9699713c4cc40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc47 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.308944:0:22721:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff200/0x50a9699713c4cc40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cc47 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138057.309020:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175909120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138057.309066:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.309107:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e180c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138057.309270:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175909120 00000100:00100000:1.0:1783138057.309277:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175909120 00000100:00100000:1.0:1783138057.309349:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783138057.309359:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+12:22721:x1869755175909120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138057.310638:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+12:22721:x1869755175909120:12345-0@lo:501:mount.lustre.0 Request processed in 1275us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138057.310923:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783138057.312079:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175909120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138057.312137:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175909248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138057.312200:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.312243:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e180c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783138057.313669:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175909248 00000100:00100000:2.0:1783138057.313681:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175909248 00000100:00100000:2.0:1783138057.314598:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783138057.314612:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+12:22721:x1869755175909248:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138057.314977:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+12:22721:x1869755175909248:12345-0@lo:503:mount.lustre.0 Request processed in 367us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138057.314987:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783138057.316017:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175909248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138057.328026:0:22775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22775:1869755175909376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138057.328105:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.328143:0:22775:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f07c3fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783138057.328668:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175909376 00000100:00100000:3.0:1783138057.328676:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175909376 00000100:00100000:3.0:1783138057.328732:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783138057.328742:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+12:22775:x1869755175909376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783138057.329671:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+12:22775:x1869755175909376:12345-0@lo:502:llog_process_th.0 Request processed in 918us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138057.329692:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783138057.330004:0:22775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22775:1869755175909376:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783138057.330073:0:22775:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783138057.330088:0:22775:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e3f04458000) 00000020:00000080:2.0:1783138057.330107:0:22775:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1783138057.330270:0:22775:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e3f3625b800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783138057.330274:0:22775:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e3f3625b800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783138057.330277:0:22775:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3f3625b800 4 00010000:00080000:2.0:1783138057.330306:0:22775:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3f1f987000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1783138057.347418:0:22775:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1783138057.349642:0:22775:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783138057.349688:0:22775:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783138057.349701:0:22775:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x50a9699713c4cc55 00000100:00080000:2.0:1783138057.349724:0:22775:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783138057.349731:0:22775:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e3f1f987000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138057.349766:0:22775:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f3f48d180 x1869755175909504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138057.349803:0:22775:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783138057.350069:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869755175909504:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783138057.350146:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.352476:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175909504 00000100:00100000:2.0:1783138057.352492:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175909504 00000100:00100000:2.0:1783138057.352529:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138057.352548:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869755175909504:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783138057.352637:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869755175909504:12345-0@lo:38:llog_process_th.0 Request processed in 98us (2489us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783138057.352644:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138057.352694:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783138057.352701:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f1f987000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138057.352706:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783138057.352709:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869755175909504:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783138057.356705:0:22775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22775:1869755175909632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138057.356785:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.356835:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175909632 00000100:00100000:2.0:1783138057.356842:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175909632 00000100:00100000:2.0:1783138057.358526:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783138057.358551:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+12:22775:x1869755175909632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138057.358701:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+12:22775:x1869755175909632:12345-0@lo:502:llog_process_th.0 Request processed in 164us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138057.358709:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783138057.358769:0:22775:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e03755480 going to sleep for 11 seconds 00000100:00100000:2.0:1783138057.358792:0:22775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22775:1869755175909632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138057.358845:0:22775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22775:1869755175909760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138057.359054:0:22775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.359082:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175909760 00000100:00100000:2.0:1783138057.359087:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175909760 00000100:00100000:2.0:1783138057.359112:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783138057.359118:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+12:22775:x1869755175909760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783138057.359178:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+12:22775:x1869755175909760:12345-0@lo:502:llog_process_th.0 Request processed in 60us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138057.359185:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783138057.359212:0:22775:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e03755480 going to sleep for 11 seconds 00000100:00100000:2.0:1783138057.359223:0:22775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff132a53-abfa-4987-a345-1706880f10ac:22775:1869755175909760:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783138057.359240:0:22775:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783138057.359783:0:22721:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783138057.359808:0:22721:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783138057.359830:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff200/0x50a9699713c4cc40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc47 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138057.359841:0:22721:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3e028ff200/0x50a9699713c4cc40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc47 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783138057.359897:0:22721:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783138057.359899:0:22721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783138057.359901:0:22721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138057.359902:0:22721:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138057.359903:0:22721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138057.359905:0:22721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138057.359907:0:22721:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138057.359908:0:22721:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783138057.359910:0:22721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138057.359911:0:22721:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783138057.359914:0:22721:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783138057.359917:0:22721:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783138057.359918:0:22721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783138057.359919:0:22721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138057.359920:0:22721:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138057.359921:0:22721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138057.359922:0:22721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138057.359923:0:22721:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138057.359924:0:22721:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783138057.359926:0:22721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138057.359926:0:22721:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783138057.359942:0:22721:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783138057.359954:0:22721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175909888:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783138057.359998:0:22721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138057.360024:0:22721:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f099fcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783138057.360171:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175909888 00000100:00100000:3.0:1783138057.360177:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175909888 00000100:00100000:3.0:1783138057.360205:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783138057.360213:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+12:22721:x1869755175909888:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783138057.360233:0:22735:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783138057.360245:0:22735:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783138057.368214:0:22735:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783138057.368283:0:22735:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783138057.374673:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+12:22721:x1869755175909888:12345-0@lo:253:mount.lustre.0 Request processed in 14451us (14665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138057.374686:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:1.0:1783138057.379350:0:22758:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783138057.379361:0:22758:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1783138057.379417:0:22721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:22721:1869755175909888:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783138057.379445:0:22721:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783138057.379448:0:22721:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783138057.379450:0:22721:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783138057.379451:0:22721:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138057.379452:0:22721:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138057.379453:0:22721:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138057.379455:0:22721:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138057.379457:0:22721:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138057.379458:0:22721:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783138057.379460:0:22721:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138057.379461:0:22721:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783138057.379477:0:22721:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1783138057.381418:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.381942:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cc24 expref: 11 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.381951:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.382004:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4cc24 expref: 11 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.382019:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4cc24 expref: 11 pid: 22736 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138057.382032:0:22758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175910016:0@lo:104: 00000100:00100000:0.0:1783138057.382094:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138057.382142:0:22758:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e1803c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138057.382341:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175910016 00000100:00100000:2.0:1783138057.382348:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175910016 00000100:00100000:2.0:1783138057.382393:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138057.382402:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+3:22758:x1869755175910016:12345-0@lo:104: 00010000:00010000:2.0:1783138057.382415:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.382492:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783138057.382498:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+3:22758:x1869755175910016:12345-0@lo:104: Request processed in 98us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138057.382505:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783138057.382989:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138057.382996:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.383003:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028ffa00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:0.0:1783138057.383008:0:22731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.383016:0:22731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138057.383023:0:22731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138057.383029:0:22731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783138057.383072:0:22731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.383078:0:22731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783138057.383100:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.383117:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffa00/0x50a9699713c4cc24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cc2b expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138057.383138:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138057.383140:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138057.383142:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138057.383178:0:22758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175910016:0@lo:104: 00010000:00010000:0.0:1783138057.383198:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138057.383401:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783138057.383415:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175910144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138057.383485:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138057.383580:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175910144 00000100:00100000:2.0:1783138057.383585:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175910144 00010000:00010000:2.0:1783138057.383605:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cc24 expref: 12 pid: 22736 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138057.383636:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138057.383650:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff132a53-abfa-4987-a345-1706880f10ac+12:3658:x1869755175910144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138057.383662:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138057.383666:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cc24 expref: 12 pid: 22736 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.383677:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4cc24 expref: 12 pid: 22736 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.383690:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4cc24 expref: 12 pid: 22736 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.383703:0:22727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.383711:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783138057.383726:0:22727:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004365398s 00010000:00010000:2.0:1783138057.383730:0:22727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.383736:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.383743:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.383749:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.383755:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028fe800 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138057.383764:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.383771:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.383786:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.383795:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138057.383832:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff132a53-abfa-4987-a345-1706880f10ac+11:3658:x1869755175910144:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138057.383839:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138057.384046:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175910144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138057.384067:0:22758:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.384074:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138057.384080:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028fe800/0x50a9699713c4cc5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783138057.401091:0:22721:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:1.0:1783138057.401711:0:22721:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1783138057.402015:0:22782:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:2.0:1783138057.402021:0:22782:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:0.0:1783138057.402093:0:22783:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1783138057.402466:0:22783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783138057.405190:0:22783:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783138057.405280:0:22783:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1783138057.407006:0:22721:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1783138057.407768:0:22784:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9e3f3f48d180 x1869755175910272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138057.407785:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00000040:01000000:0.0:1783138057.408218:0:22721:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783138057.408569:0:22721:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783138057.409107:0:22721:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783138057.409118:0:22721:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783138057.409163:0:22721:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783138057.410997:0:22721:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783138057.411843:0:22721:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783138057.412052:0:22721:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783138057.413641:0:22721:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1783138057.414297:0:22721:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1783138057.417706:0:22721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1783138057.419710:0:22721:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783138057.419759:0:22721:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbaa8c1c5b988 00100000:10000000:0.0:1783138057.419767:0:22721:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1783138057.420754:0:22721:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783138057.420768:0:22721:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783138057.420787:0:22721:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1783138057.420803:0:22721:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783138057.426334:0:22721:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783138057.426662:0:22721:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783138058.042112:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783138058.363598:0:22776:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783138058.363607:0:22776:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783138058.372132:0:22776:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783138058.372152:0:22776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783138058.428771:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 10000000:01000000:2.0:1783138058.553559:0:22739:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783138058.553567:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9e3f3625b800 from 11 10000000:01000000:2.0:1783138058.553588:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783138058.553636:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138058.553649:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138058.553661:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138058.553691:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175910400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783138058.553761:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138058.553815:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2aed0840 going to sleep for 11 seconds 00000100:00100000:0.0:1783138058.554384:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175910400 00000100:00100000:0.0:1783138058.554392:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175910400 00000100:00100000:0.0:1783138058.554519:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783138058.554540:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+11:22739:x1869755175910400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138058.554556:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138058.554573:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4cc6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cc63 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138058.554598:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4cc6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cc63 expref: 12 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138058.554609:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4cc6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cc63 expref: 12 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138058.554618:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028ffc00, rc 0) 00000100:00100000:0.0:1783138058.554735:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+12:22739:x1869755175910400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138058.554743:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783138058.556198:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175910400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138058.556223:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138058.556234:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138058.556305:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175910528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783138058.556390:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138058.556543:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175910528 00000100:00100000:2.0:1783138058.556550:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175910528 00000100:00100000:2.0:1783138058.556587:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783138058.556596:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+12:22739:x1869755175910528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783138058.556616:0:22735:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783138058.556641:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783138058.556644:0:22735:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1783138058.564064:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+12:22739:x1869755175910528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 7462us (7666us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138058.564078:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783138058.565585:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e17e900 going to sleep for 11 seconds 00000100:00100000:1.0:1783138058.565756:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175910528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783138058.565828:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783138058.565840:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138058.565851:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138059.069296:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783138059.388014:0:22776:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783138059.388024:0:22776:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783138059.388149:0:22776:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1783138059.388670:0:22776:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783138059.388818:0:22776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:1.0:1783138059.452567:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783138060.099637:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138060.477092:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783138061.118113:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138061.497610:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783138062.147802:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783138062.258762:0:23026:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1783138062.524570:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00000100:00080000:3.0:1783138062.713760:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783138062.713767:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783138062.713771:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138062.713779:0:16974:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 719 00000100:00080000:3.0:1783138062.713784:0:16974:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783138062.713790:0:16974:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e3e0413b000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1783138062.713810:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2a987100 x1869755175910784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138062.713833:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138062.713836:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138062.713839:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138062.713857:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138062.713859:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783138062.713862:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783138062.713864:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3f1f987000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138062.713868:0:16974:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e3f1f987000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1783138062.713881:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2a984e00 x1869755175910912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783138062.714011:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175910784:0@lo:38:kworker.0 00000100:00100000:0.0:1783138062.714102:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138062.714149:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869755175910912:0@lo:38:kworker.0 00000100:00100000:0.0:1783138062.714189:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138062.714266:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175910784 00000100:00100000:3.0:1783138062.714275:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175910784 00000100:00100000:3.0:1783138062.714332:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783138062.714340:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1869755175910784:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783138062.714355:0:22748:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783138062.714475:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1869755175910784:12345-0@lo:38:kworker.0 Request processed in 133us (372us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783138062.714482:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783138062.714532:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138062.714536:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783138062.714540:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175910784:0@lo:38:kworker.0 00000100:00100000:1.0:1783138062.714674:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175910656:0@lo:400:kworker.0 00000100:00100000:1.0:1783138062.714706:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138062.714852:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175910656 00000100:00100000:3.0:1783138062.714857:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175910656 00000100:00100000:3.0:1783138062.714899:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783138062.714906:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+12:3660:x1869755175910656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138062.714963:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+12:3660:x1869755175910656:12345-0@lo:400:kworker.0 Request processed in 57us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138062.714969:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783138062.715081:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175910912 00000100:00100000:2.0:1783138062.715086:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175910912 00000100:00100000:2.0:1783138062.715113:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138062.715118:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869755175910912:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783138062.715146:0:22744:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 724 last 0 00000020:00000080:2.0:1783138062.715186:0:22744:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x50a9699713c4cc71 00000004:00100000:2.0:1783138062.715200:0:22744:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783138062.715359:0:22744:0:(import.c:65:import_set_state_nolock()) ffff9e3f3e273000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783138062.715592:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175910656:0@lo:400:kworker.0 00000100:00100000:2.0:1783138062.715711:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1869755175910912:12345-0@lo:38:kworker.0 Request processed in 591us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138062.715718:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783138062.719933:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e3f2a984e00 x1869755175910912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783138062.719954:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1783138062.719963:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783138062.719968:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783138062.719984:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f1f987000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783138062.719991:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1869755175910912:0@lo:38:kworker.0 00010000:00010000:1.0:1783138063.168828:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783138063.352664:0:23079:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783138063.352922:0:23079:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783138063.545782:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783138064.185465:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783138064.307938:0:23130:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783138064.308309:0:23130:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783138064.569453:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783138065.209689:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138065.593843:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783138066.233743:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138066.623489:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783138067.257758:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138067.644615:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00000100:00100000:3.0:1783138067.833496:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138057/real 1783138057] req@ffff9e3f3f48df80 x1869755175907840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138067.833533:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3f3f48df80 x1869755175907840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138067.833545:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138057/real 1783138057] req@ffff9e3f2f883b80 x1869755175907456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138067.833558:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3f2f883b80 x1869755175907456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783138067.833577:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f1f987800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138067.833586:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783138067.833590:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175907840:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783138067.833595:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e038b4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138067.833600:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783138067.833602:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175907456:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783138067.833893:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783138067.833899:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783138067.833903:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138067.833908:0:16974:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 724 00000100:00080000:2.0:1783138067.833913:0:16974:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783138067.833920:0:16974:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e3e0413b000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138067.833941:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f3f48f100 x1869755175911168/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138067.833959:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138067.833962:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783138067.833964:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3e038b4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138067.833967:0:16974:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 719 00000100:00080000:2.0:1783138067.833970:0:16974:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783138067.833973:0:16974:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e3e038b4800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138067.833984:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f3f48d880 x1869755175911296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138067.834002:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138067.834005:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783138067.834007:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3f1f987800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138067.834024:0:16974:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 719 00000100:00080000:2.0:1783138067.834027:0:16974:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783138067.834031:0:16974:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e3f1f987800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138067.834044:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f3f48fb80 x1869755175911424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783138067.834092:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175911552:0@lo:400:kworker.0 00000100:00100000:2.0:1783138067.834163:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138067.834242:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175911552 00000100:00100000:2.0:1783138067.834249:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175911552 00000100:00100000:2.0:1783138067.834290:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138067.834300:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175911552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138067.834391:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175911552:12345-0@lo:400:kworker.0 Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138067.834398:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783138067.834440:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e3f3f48f480 x1869755175911552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138067.834451:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175911552:0@lo:400:kworker.0 00000100:00100000:1.0:1783138067.834813:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783138067.834827:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175911040:0@lo:400:kworker.0 00000100:00100000:1.0:1783138067.834872:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138067.834969:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175911168:0@lo:38:kworker.0 00000100:00100000:3.0:1783138067.835015:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138067.835043:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175911296:0@lo:8:kworker.0 00000400:00000100:3.0:1783138067.835066:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755175911296 offset 0 length 520: 4 00000100:00100000:3.0:1783138067.835085:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175911424:0@lo:8:kworker.0 00000400:00000100:3.0:1783138067.835103:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755175911424 offset 0 length 520: 4 00000100:00100000:1.0:1783138067.835168:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175911168 00000100:00100000:1.0:1783138067.835174:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175911168 00000100:00100000:1.0:1783138067.835210:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138067.835216:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1869755175911168:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783138067.835236:0:22748:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783138067.835273:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1869755175911168:12345-0@lo:38:kworker.0 Request processed in 55us (257us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783138067.835279:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1783138067.835366:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138067.835371:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783138067.835374:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175911168:0@lo:38:kworker.0 00000100:00100000:2.0:1783138067.835507:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175911040 00000100:00100000:2.0:1783138067.835512:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175911040 00000100:00100000:2.0:1783138067.835550:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783138067.835557:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+12:3660:x1869755175911040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138067.835604:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+12:3660:x1869755175911040:12345-0@lo:400:kworker.0 Request processed in 48us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138067.835610:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783138067.835925:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175911040:0@lo:400:kworker.0 00010000:00010000:0.0:1783138068.299427:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138068.667115:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:0.0:1783138069.307995:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783138069.626254:0:22776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783138069.693368:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:0.0:1783138070.332838:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138070.716435:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783138071.353973:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783138071.442247:0:23475:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783138071.442252:0:23475:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1783138071.442254:0:23475:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783138071.442426:0:23475:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e3e038cb000 00000020:01000004:1.0:1783138071.442451:0:23475:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1783138071.442463:0:23475:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783138071.442480:0:23475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9e3f2a83cd40) 00000020:00000080:1.0:1783138071.442496:0:23475:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783138071.544754:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.545417:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783138071.546060:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.546591:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.548970:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.551572:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.552188:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.553365:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1783138071.553764:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.553977:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1783138071.554300:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.555896:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783138071.557874:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.560568:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1783138071.561039:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783138071.561367:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.562512:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.563465:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.564011:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783138071.564564:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783138071.564988:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783138071.565211:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1783138071.569253:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783138071.571507:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1783138071.572293:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783138071.573494:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783138071.573786:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1783138071.574167:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783138071.574605:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1783138071.574925:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783138071.575279:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783138071.575620:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783138071.575876:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1783138071.576723:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1783138071.592387:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1783138071.610287:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1783138071.611586:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1783138071.612182:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783138071.612479:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1783138071.612742:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783138071.613160:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1783138071.613416:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1783138071.613624:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1783138071.614139:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783138071.622014:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1783138071.622871:0:23475:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:01000000:1.0:1783138071.624847:0:23475:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783138071.625634:0:23475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1783138071.625647:0:23475:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783138071.625661:0:23475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50a9699713c4cc7f 00000020:01000004:1.0:1783138071.625668:0:23475:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1783138071.625692:0:23475:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783138071.625697:0:23475:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783138071.625703:0:23475:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1783138071.625732:0:23475:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1783138071.625737:0:23475:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1783138071.643739:0:23475:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783138071.643787:0:23475:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1783138071.643791:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783138071.643793:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783138071.643799:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138071.643800:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138071.643801:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138071.643802:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138071.643803:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783138071.643805:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138071.643806:0:23475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783138071.643809:0:23475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1783138071.643811:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783138071.643812:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783138071.643813:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138071.643814:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138071.643815:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138071.643816:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138071.643816:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783138071.643817:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138071.643818:0:23475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783138071.643848:0:23475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783138071.643872:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175911680:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783138071.643951:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138071.644051:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2af82900 going to sleep for 11 seconds 00000100:00100000:0.0:1783138071.644952:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175911680 00000100:00100000:0.0:1783138071.644962:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175911680 00000100:00100000:0.0:1783138071.645027:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783138071.645037:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+12:23475:x1869755175911680:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783138071.645141:0:22736:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783138071.645146:0:22736:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1783138071.645154:0:22736:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1783138071.645568:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+12:23475:x1869755175911680:12345-0@lo:253:mount.lustre.0 Request processed in 530us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.645576:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783138071.645915:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175911680:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783138071.645930:0:23475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1783138071.645933:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783138071.645935:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783138071.645936:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138071.645937:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138071.645938:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138071.645940:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138071.645941:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138071.645943:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138071.645944:0:23475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783138071.645965:0:23475:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e3e038cb000 from lustre-MDT0001 10000000:01000000:1.0:1783138071.646004:0:23475:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1783138071.646008:0:23475:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1783138071.646015:0:23475:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e3f0445cd40 local copy 00010000:00010000:1.0:1783138071.646027:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138071.646161:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175911808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138071.646212:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.646308:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0395f540 going to sleep for 11 seconds 00000100:00100000:3.0:1783138071.648835:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175911808 00000100:00100000:3.0:1783138071.648853:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175911808 00000100:00100000:3.0:1783138071.649107:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783138071.649119:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+12:23475:x1869755175911808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138071.649280:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+12:23475:x1869755175911808:12345-0@lo:501:mount.lustre.0 Request processed in 164us (3067us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783138071.649289:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783138071.649862:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175911808:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783138071.649891:0:23475:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783138071.649928:0:23475:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783138071.649937:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.649947:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138071.649976:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e3e038cb000 10000000:01000000:1.0:1783138071.649981:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783138071.649985:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e3f0445cd40 10000000:01000000:1.0:1783138071.649988:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1783138071.649991:0:23475:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9e3f0445cd40 from 1 10000000:01000000:1.0:1783138071.649994:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1783138071.650026:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffa00/0x50a9699713c4cc86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.650034:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffa00/0x50a9699713c4cc86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.650044:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffa00/0x50a9699713c4cc86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138071.650075:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175911936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138071.650117:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.650177:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0395f540 going to sleep for 11 seconds 00000100:00100000:3.0:1783138071.650551:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175911936 00000100:00100000:3.0:1783138071.650558:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175911936 00000100:00100000:3.0:1783138071.650589:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783138071.650597:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+12:23475:x1869755175911936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138071.650609:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138071.650635:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc8d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cc86 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138071.650665:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cc86 expref: 13 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138071.650676:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f00031000/0x50a9699713c4cc8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cc86 expref: 13 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138071.650692:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f00031000, rc 0) 00000100:00100000:3.0:1783138071.650736:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+13:23475:x1869755175911936:12345-0@lo:101:mount.lustre.0 Request processed in 140us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138071.650742:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783138071.650969:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175911936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138071.650983:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffa00/0x50a9699713c4cc86 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc8d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.650992:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffa00/0x50a9699713c4cc86 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cc8d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138071.651009:0:23475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1783138071.651028:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffa00/0x50a9699713c4cc86 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc8d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.651035:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffa00/0x50a9699713c4cc86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc8d expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138071.651045:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e3e038cb000 10000000:01000000:1.0:1783138071.651057:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783138071.651061:0:23475:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9e3e038cb000 from 1 10000000:01000000:1.0:1783138071.651063:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783138071.651081:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff600/0x50a9699713c4cc94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.651089:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff600/0x50a9699713c4cc94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.651096:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff600/0x50a9699713c4cc94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138071.651110:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138071.651139:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.651168:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0395f540 going to sleep for 11 seconds 00000100:00100000:3.0:1783138071.651453:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175912064 00000100:00100000:3.0:1783138071.651458:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175912064 00000100:00100000:3.0:1783138071.651480:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783138071.651487:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+13:23475:x1869755175912064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138071.651495:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138071.651505:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f00031c00/0x50a9699713c4cc9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cc94 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138071.651520:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f00031c00/0x50a9699713c4cc9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cc94 expref: 14 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138071.651528:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f00031c00/0x50a9699713c4cc9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cc94 expref: 14 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138071.651534:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f00031c00, rc 0) 00000100:00100000:3.0:1783138071.651572:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+14:23475:x1869755175912064:12345-0@lo:101:mount.lustre.0 Request processed in 85us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138071.651579:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783138071.651779:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138071.651791:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff600/0x50a9699713c4cc94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc9b expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.651799:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff600/0x50a9699713c4cc94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cc9b expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138071.651810:0:23475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783138071.651824:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff600/0x50a9699713c4cc94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc9b expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.651831:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff600/0x50a9699713c4cc94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cc9b expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138071.651838:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1783138071.651842:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783138071.651847:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e3e038cb000 10000000:01000000:1.0:1783138071.651850:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783138071.651852:0:23475:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1783138071.651854:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783138071.651868:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff400/0x50a9699713c4cca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.651876:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff400/0x50a9699713c4cca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.651883:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff400/0x50a9699713c4cca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138071.652140:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138071.652172:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.652194:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0395f540 going to sleep for 11 seconds 00000100:00100000:3.0:1783138071.652297:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175912192 00000100:00100000:3.0:1783138071.652302:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175912192 00000100:00100000:3.0:1783138071.652365:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783138071.652372:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+14:23475:x1869755175912192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138071.652380:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138071.652396:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f00031e00/0x50a9699713c4cca9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cca2 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138071.652412:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f00031e00/0x50a9699713c4cca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cca2 expref: 15 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138071.652420:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f00031e00/0x50a9699713c4cca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cca2 expref: 15 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138071.652426:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f00031e00, rc 0) 00000100:00100000:3.0:1783138071.652465:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+15:23475:x1869755175912192:12345-0@lo:101:mount.lustre.0 Request processed in 93us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138071.652472:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783138071.652558:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138071.652567:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff400/0x50a9699713c4cca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cca9 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.652574:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff400/0x50a9699713c4cca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cca9 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783138071.654566:0:23475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1783138071.656568:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783138071.669673:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1783138071.669735:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1783138071.669752:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1783138071.669767:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1783138071.669779:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1783138071.669791:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1783138071.669802:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1783138071.669813:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1783138071.669825:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1783138071.669838:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1783138071.669850:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1783138071.669864:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1783138071.669877:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1783138071.669892:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1783138071.669903:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1783138071.669915:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1783138071.669928:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1783138071.669956:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1783138071.669969:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1783138071.669983:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1783138071.669995:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1783138071.670006:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1783138071.670017:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1783138071.670029:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1783138071.670042:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1783138071.670054:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1783138071.670072:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1783138071.670084:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1783138071.670096:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1783138071.670106:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1783138071.670117:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1783138071.670128:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1783138071.670140:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1783138071.670151:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1783138071.670162:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1783138071.670174:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1783138071.670187:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1783138071.670198:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1783138071.670211:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1783138071.670225:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1783138071.670238:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1783138071.670251:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1783138071.670263:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1783138071.670275:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1783138071.670300:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1783138071.670304:0:23475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1783138071.673679:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138071.673748:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.673793:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f36581c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783138071.674173:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175912320 00000100:00100000:3.0:1783138071.674181:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175912320 00000100:00100000:3.0:1783138071.674238:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783138071.674248:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+15:23475:x1869755175912320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138071.674754:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+15:23475:x1869755175912320:12345-0@lo:501:mount.lustre.0 Request processed in 505us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138071.674763:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783138071.674919:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138071.674965:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138071.675012:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.675111:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f36581c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783138071.678301:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175912448 00000100:00100000:2.0:1783138071.678479:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175912448 00000100:00100000:3.0:1783138071.679930:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783138071.679944:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+15:23475:x1869755175912448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138071.681412:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+15:23475:x1869755175912448:12345-0@lo:503:mount.lustre.0 Request processed in 1464us (6392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138071.681425:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783138071.681565:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912448:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783138071.682018:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783138071.682128:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138071.682185:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.682229:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f36581c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783138071.682520:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175912576 00000100:00100000:3.0:1783138071.682527:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175912576 00000100:00100000:3.0:1783138071.682576:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783138071.682592:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+15:23475:x1869755175912576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138071.683348:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+15:23475:x1869755175912576:12345-0@lo:502:mount.lustre.0 Request processed in 753us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138071.683358:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783138071.683484:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138071.683675:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1783138071.683705:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1783138071.683720:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1783138071.683733:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1783138071.683746:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1783138071.683758:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1783138071.683771:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1783138071.683783:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1783138071.683800:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1783138071.683815:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1783138071.683828:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1783138071.683842:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1783138071.683855:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1783138071.683869:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1783138071.683882:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1783138071.683895:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1783138071.683908:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1783138071.683921:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1783138071.683944:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1783138071.683957:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1783138071.683972:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1783138071.683985:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1783138071.684000:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1783138071.684013:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1783138071.684026:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1783138071.684040:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1783138071.684052:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1783138071.684064:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1783138071.684077:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1783138071.684111:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1783138071.684126:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1783138071.684138:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1783138071.684150:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1783138071.684162:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1783138071.684174:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1783138071.684187:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1783138071.684200:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1783138071.684214:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1783138071.684228:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1783138071.684239:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1783138071.684254:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1783138071.684267:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1783138071.684281:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1783138071.684294:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1783138071.684360:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138071.684413:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.684461:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f36581c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783138071.684656:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175912704 00000100:00100000:3.0:1783138071.684662:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175912704 00000100:00100000:3.0:1783138071.684704:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783138071.684713:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+15:23475:x1869755175912704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138071.684836:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+15:23475:x1869755175912704:12345-0@lo:502:mount.lustre.0 Request processed in 123us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138071.684843:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783138071.685074:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175912704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783138071.685152:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1783138071.685164:0:23475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1783138071.686061:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138071.686074:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138071.686076:0:23479:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783138071.686082:0:23479:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1783138071.686100:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783138071.686115:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9e3f362499c0) 00000020:00000080:2.0:1783138071.686136:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1783138071.686142:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783138071.686213:0:23479:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783138071.686227:0:23479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50a9699713c4ccb7 00000020:00000080:2.0:1783138071.686667:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1783138071.686673:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783138071.686677:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138071.686678:0:23479:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783138071.686681:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783138071.686685:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138071.686686:0:23479:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1783138071.686689:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783138071.686697:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9e3f3624b380) 00000020:00000080:2.0:1783138071.686709:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1783138071.686713:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783138071.686715:0:23479:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1783138071.686717:0:23479:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1783138071.686723:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783138071.686772:0:23479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e3e038cb000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1783138071.686784:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9e3f3624cd40) 00000020:00000080:2.0:1783138071.686794:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1783138071.686867:0:23479:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783138071.686874:0:23479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50a9699713c4cccc 00000020:00000080:2.0:1783138071.686977:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1783138071.686986:0:23479:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783138071.686990:0:23479:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x50a9699713c4ccd3 00080000:01000000:2.0:1783138071.686996:0:23479:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783138071.686999:0:23479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50a9699713c4ccda 00000100:00100000:3.0:1783138071.747608:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783138071.815290:0:23479:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1783138071.816139:0:23479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1783138071.816611:0:23479:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783138071.825646:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1783138071.825660:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138071.825668:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.825670:0:23479:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1783138071.825675:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138071.825681:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.825683:0:23479:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1783138071.825686:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783138071.825691:0:23479:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:00000080:0.0:1783138071.825720:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783138071.825737:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9e3f2b080000) 00000020:00000080:0.0:1783138071.825760:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1783138071.825766:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783138071.825845:0:23479:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1783138071.825851:0:23479:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783138071.825858:0:23479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50a9699713c4cce8 00010000:00080000:0.0:1783138071.825890:0:23479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3f071b1800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1783138071.827536:0:23479:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1783138071.833183:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783138071.833199:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783138071.833241:0:23479:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783138071.833262:0:23479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50a9699713c4ccef 00000100:00080000:0.0:1783138071.833273:0:23479:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783138071.833279:0:23479:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e3f071b1800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138071.833342:0:23479:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e03b02a00 x1869755175912832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138071.833370:0:23479:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1783138071.833424:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138071.833428:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.833441:0:23479:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1783138071.833444:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783138071.833447:0:23479:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1783138071.833449:0:23479:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783138071.833450:0:23479:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783138071.833452:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783138071.833455:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.833456:0:23479:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783138071.833458:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138071.833462:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.833464:0:23479:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1783138071.833467:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783138071.833493:0:23479:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783138071.833503:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138071.833505:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.833507:0:23479:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1783138071.833509:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783138071.833511:0:23479:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1783138071.833512:0:23479:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783138071.833526:0:23479:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783138071.833528:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783138071.833530:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.833531:0:23479:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783138071.833534:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783138071.833537:0:23479:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783138071.833540:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.833541:0:23479:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783138071.833544:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783138071.833548:0:23479:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:0.0:1783138071.833567:0:23479:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783138071.833569:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783138071.833581:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9e3f2b084d40) 00000020:00000080:0.0:1783138071.833592:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1783138071.833596:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783138071.833651:0:23479:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1783138071.833656:0:23479:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783138071.833662:0:23479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50a9699713c4ccfd 00010000:00080000:0.0:1783138071.833693:0:23479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3f0af9d000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1783138071.833897:0:23479:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1783138071.834470:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783138071.834476:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783138071.834479:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138071.834485:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 729 00000100:00080000:2.0:1783138071.834488:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783138071.834494:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e3e0413b000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138071.834520:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f3f48ed80 x1869755175912960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138071.834543:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138071.834546:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138071.834549:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138071.834551:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783138071.834589:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783138071.834603:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175913088:0@lo:400:kworker.0 00000100:00100000:2.0:1783138071.834659:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138071.834997:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175912832:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783138071.835037:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138071.835071:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175912960:0@lo:38:kworker.0 00000100:00100000:3.0:1783138071.835109:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138071.835150:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175913088 00000100:00100000:3.0:1783138071.835158:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175913088 00000100:00100000:3.0:1783138071.835202:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783138071.835211:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175913088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138071.835263:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175913088:12345-0@lo:400:kworker.0 Request processed in 52us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138071.835270:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783138071.835291:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175912832 00000100:00100000:3.0:1783138071.835295:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175912832 00000100:00100000:3.0:1783138071.835306:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175912960 00000100:00100000:3.0:1783138071.835351:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175912960 00000100:00100000:3.0:1783138071.835369:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783138071.835373:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1869755175912832:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783138071.835393:0:22747:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 733 last 0 00000020:00000080:3.0:1783138071.835424:0:22747:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50a9699713c4cd04 00000004:00100000:3.0:1783138071.835450:0:22747:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783138071.835456:0:22747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:3.0:1783138071.835560:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e3f3f48f800 x1869755175913088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138071.835572:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175913088:0@lo:400:kworker.0 00000040:01000000:2.0:1783138071.836393:0:23479:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783138071.836693:0:23479:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1783138071.838914:0:23479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783138071.841821:0:23479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1783138071.842013:0:23479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:2.0:1783138071.843767:0:22747:0:(import.c:65:import_set_state_nolock()) ffff9e3f3612c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138071.843863:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1869755175912832:12345-0@lo:38:llog_process_th.0 Request processed in 8486us (8823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138071.843877:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138071.843906:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783138071.843913:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1869755175912960:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783138071.843961:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1869755175912960:12345-0@lo:38:kworker.0 Request processed in 48us (8851us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783138071.843967:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138071.844115:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783138071.844125:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1783138071.844133:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783138071.844138:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783138071.844142:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f071b1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783138071.844163:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175912832:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783138071.844176:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783138071.844180:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138071.844184:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783138071.844187:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175912960:0@lo:38:kworker.0 00000100:00100000:0.0:1783138071.844609:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175913216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138071.844657:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138071.844702:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175913216 00000100:00100000:0.0:1783138071.844709:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175913216 00000100:00100000:0.0:1783138071.844744:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138071.844751:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3660:x1869755175913216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783138071.844779:0:22748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783138071.844816:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3660:x1869755175913216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.844835:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138071.844873:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175913216:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1783138071.845100:0:23484:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1783138071.845106:0:23484:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783138071.850630:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783138071.850646:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783138071.850694:0:23479:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783138071.850716:0:23479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50a9699713c4cd0b 00000100:00080000:1.0:1783138071.850728:0:23479:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783138071.850735:0:23479:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e3f0af9d000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1783138071.850771:0:23479:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2f881c00 x1869755175913344/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783138071.850798:0:23479:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783138071.850856:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138071.850860:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138071.850861:0:23479:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783138071.850864:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783138071.850867:0:23479:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1783138071.850868:0:23479:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783138071.850869:0:23479:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783138071.850871:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783138071.850873:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138071.850875:0:23479:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783138071.850877:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783138071.850881:0:23479:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1783138071.850885:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138071.850886:0:23479:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783138071.850889:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783138071.850892:0:23479:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:1.0:1783138071.850915:0:23479:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1783138071.850918:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783138071.850928:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9e3f2a838000) 00000020:00000080:1.0:1783138071.850940:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1783138071.850945:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783138071.851002:0:23479:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1783138071.851018:0:23479:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783138071.851024:0:23479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x50a9699713c4cd19 00010000:00080000:1.0:1783138071.851066:0:23479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3f340c6000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.143@tcp at head 00000100:00100000:3.0:1783138071.851163:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175913344:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783138071.851222:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755175913344 offset 0 length 520: 4 00010000:00010000:1.0:1783138071.851278:0:23479:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1783138071.851394:0:23479:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783138071.851412:0:23479:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1783138071.851425:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138071.851442:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138071.851444:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138071.851453:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1783138071.853024:0:23479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783138071.853234:0:23479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1783138071.853396:0:23479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1783138071.853825:0:23486:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1783138071.853830:0:23486:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783138071.854650:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783138071.854662:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783138071.854700:0:23479:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783138071.854722:0:23479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50a9699713c4cd20 00000100:00080000:0.0:1783138071.854733:0:23479:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783138071.854738:0:23479:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e3f340c6000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138071.854775:0:23479:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e03b02d80 x1869755175913472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138071.854842:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175913472:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783138071.854906:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755175913472 offset 0 length 520: 4 00000100:00080000:0.0:1783138071.854969:0:23479:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783138071.855036:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138071.855040:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.855041:0:23479:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783138071.855044:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138071.855047:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.855048:0:23479:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783138071.855050:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783138071.855052:0:23479:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783138071.855053:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138071.855055:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.855056:0:23479:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783138071.855058:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138071.855060:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.855061:0:23479:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783138071.855064:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783138071.855090:0:23479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138071.855093:0:23479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138071.855095:0:23479:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783138071.855098:0:23479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:2.0:1783138071.855237:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138071.855243:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138071.855246:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138071.855248:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1783138071.855304:0:23475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1783138071.855473:0:23475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783138071.855493:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff400/0x50a9699713c4cca2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cca9 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.855504:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff400/0x50a9699713c4cca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cca9 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138071.855512:0:23475:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9e3e038cb000 from 1 10000000:01000000:1.0:1783138071.855515:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783138071.855539:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.855547:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.855557:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138071.855573:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f880000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175913600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138071.855627:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.855654:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f36581780 going to sleep for 11 seconds 00000100:00100000:0.0:1783138071.855701:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175913600 00000100:00100000:0.0:1783138071.855708:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175913600 00000100:00100000:0.0:1783138071.855757:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783138071.855767:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+15:23475:x1869755175913600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138071.855784:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138071.855797:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e028fe400/0x50a9699713c4cd2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cd27 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138071.855821:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028fe400/0x50a9699713c4cd2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cd27 expref: 16 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138071.855832:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e028fe400/0x50a9699713c4cd2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cd27 expref: 16 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138071.855842:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028fe400, rc 0) 00000100:00100000:0.0:1783138071.855885:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+16:23475:x1869755175913600:12345-0@lo:101:mount.lustre.0 Request processed in 119us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.855892:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783138071.855938:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f880000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175913600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138071.855953:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138071.855960:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138071.856577:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175913728:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783138071.856625:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138071.856645:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f10f1e900 going to sleep for 11 seconds 00000100:00100000:1.0:1783138071.856859:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175913728 00000100:00100000:1.0:1783138071.856865:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175913728 00000100:00100000:1.0:1783138071.856909:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783138071.856917:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+16:23475:x1869755175913728:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783138071.856934:0:22735:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783138071.856952:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783138071.856956:0:22735:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1783138071.857057:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+16:23475:x1869755175913728:12345-0@lo:256:mount.lustre.0 Request processed in 140us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138071.857064:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783138071.857140:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175913728:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783138071.857824:0:23475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783138071.857842:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.857853:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138071.857862:0:23475:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9e3e038cb000 from 1 10000000:01000000:2.0:1783138071.857865:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783138071.857895:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.857903:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.857912:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138071.857928:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175913856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138071.857964:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138071.858004:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f07c2a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138071.858144:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175913856 00000100:00100000:1.0:1783138071.858150:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175913856 00000100:00100000:1.0:1783138071.858192:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783138071.858200:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+16:23475:x1869755175913856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138071.858211:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138071.858224:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f341fea00/0x50a9699713c4cd3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cd35 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.858246:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f341fea00/0x50a9699713c4cd3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cd35 expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.858256:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f341fea00/0x50a9699713c4cd3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cd35 expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.858263:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f341fea00, rc 0) 00000100:00100000:1.0:1783138071.858293:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+17:23475:x1869755175913856:12345-0@lo:101:mount.lustre.0 Request processed in 94us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138071.858306:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783138071.858475:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175913856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138071.858489:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.858498:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783138071.861225:0:23475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1783138071.861811:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138071.862045:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1783138071.862084:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1783138071.862101:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1783138071.862115:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1783138071.862126:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1783138071.862140:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1783138071.862153:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1783138071.862168:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1783138071.862181:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1783138071.862194:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1783138071.862206:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1783138071.862221:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1783138071.862226:0:23475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1783138071.862858:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a985500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175913984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138071.862933:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138071.863015:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f182473c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138071.863121:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175913984 00000100:00100000:1.0:1783138071.863128:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175913984 00000100:00100000:1.0:1783138071.863178:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783138071.863188:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+17:23475:x1869755175913984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138071.864421:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a985500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175913984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138071.864489:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a985500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138071.864549:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138071.864579:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f182473c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138071.864649:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175914112 00000100:00100000:0.0:1783138071.864656:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175914112 00000100:00100000:0.0:1783138071.864746:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783138071.864755:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175914112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138071.864863:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175914112:12345-0@lo:503:mount.lustre.0 Request processed in 108us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.864871:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783138071.864947:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a985500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783138071.865390:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783138071.865466:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a985500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138071.865505:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.865618:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+17:23475:x1869755175913984:12345-0@lo:501:mount.lustre.0 Request processed in 2430us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138071.865626:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783138071.865789:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f182473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138071.865852:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175914240 00000100:00100000:2.0:1783138071.865858:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175914240 00000100:00100000:2.0:1783138071.865886:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783138071.865893:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+17:23475:x1869755175914240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138071.865993:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+17:23475:x1869755175914240:12345-0@lo:502:mount.lustre.0 Request processed in 100us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138071.866001:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783138071.866110:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a985500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138071.866303:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783138071.866488:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1783138071.866501:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1783138071.866511:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1783138071.866522:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1783138071.866532:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1783138071.866542:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1783138071.866552:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1783138071.866562:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783138071.866573:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1783138071.866584:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1783138071.866611:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a985500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138071.866647:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138071.866661:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f182473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138071.866775:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175914368 00000100:00100000:2.0:1783138071.866780:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175914368 00000100:00100000:2.0:1783138071.866799:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783138071.866805:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+17:23475:x1869755175914368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138071.866884:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+17:23475:x1869755175914368:12345-0@lo:502:mount.lustre.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138071.866891:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783138071.866962:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a985500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138071.866997:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1783138071.867004:0:23475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783138071.867626:0:23488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138071.867637:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138071.867640:0:23488:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783138071.867646:0:23488:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e3e038cb000 00000020:00000080:3.0:1783138071.867649:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138071.867657:0:23488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138071.867659:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138071.867661:0:23488:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783138071.867663:0:23488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138071.867665:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138071.867666:0:23488:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783138071.867669:0:23488:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e3e038cb000 00000020:00000080:3.0:1783138071.867671:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138071.867733:0:23488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138071.871558:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138071.871567:0:23488:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783138071.871578:0:23488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138071.871585:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138071.871586:0:23488:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783138071.871591:0:23488:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e3e038cb000 00000020:00000080:3.0:1783138071.871594:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138071.871658:0:23488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138071.874140:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138071.874148:0:23488:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783138071.874161:0:23488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138071.874167:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138071.874169:0:23488:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783138071.874175:0:23488:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e3e038cb000 00000020:00000080:3.0:1783138071.874177:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138071.875864:0:23488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138071.875876:0:23488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138071.875878:0:23488:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783138071.875884:0:23488:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1783138071.879505:0:23475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783138071.879554:0:23475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783138071.879576:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.879590:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138071.879713:0:23475:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783138071.879716:0:23475:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e3e038cb000 10000000:01000000:0.0:1783138071.879719:0:23475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e3e038cb000 10000000:01000000:0.0:1783138071.879724:0:23475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783138071.879729:0:23475:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9e3e038cb000 from 1 10000000:01000000:0.0:1783138071.879732:0:23475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783138071.879772:0:23475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe000/0x50a9699713c4cd43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138071.879780:0:23475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe000/0x50a9699713c4cd43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138071.879791:0:23475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe000/0x50a9699713c4cd43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138071.879812:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783138071.879877:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138071.879920:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e01e05b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783138071.880474:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175914496 00000100:00100000:1.0:1783138071.880482:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175914496 00000100:00100000:1.0:1783138071.880535:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783138071.880545:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+17:23475:x1869755175914496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138071.880559:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138071.880571:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f341ff200/0x50a9699713c4cd4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cd43 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.880595:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f341ff200/0x50a9699713c4cd4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cd43 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.880605:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f341ff200/0x50a9699713c4cd4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cd43 expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.880622:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f341ff200, rc 0) 00000100:00100000:1.0:1783138071.880668:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175914496:12345-0@lo:101:mount.lustre.0 Request processed in 123us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138071.880675:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783138071.880761:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138071.880777:0:23475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe000/0x50a9699713c4cd43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd4a expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138071.880796:0:23475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe000/0x50a9699713c4cd43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cd4a expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783138071.883459:0:23475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1783138071.883763:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783138071.884002:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1783138071.884027:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1783138071.884040:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1783138071.884051:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1783138071.884063:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1783138071.884075:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1783138071.884089:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1783138071.884103:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1783138071.884117:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1783138071.884132:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1783138071.884145:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1783138071.884157:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1783138071.884171:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1783138071.884182:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1783138071.884194:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1783138071.884222:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1783138071.884240:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1783138071.884254:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1783138071.884265:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1783138071.884276:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1783138071.884288:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1783138071.884302:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1783138071.886488:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1783138071.886535:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1783138071.886553:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1783138071.886580:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1783138071.886596:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1783138071.886610:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1783138071.886625:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1783138071.886639:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1783138071.886652:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1783138071.886682:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1783138071.886699:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1783138071.886711:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1783138071.886725:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1783138071.886739:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1783138071.886752:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1783138071.886766:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1783138071.886781:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1783138071.886795:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1783138071.886809:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1783138071.886824:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1783138071.886836:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1783138071.886849:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1783138071.886863:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1783138071.886876:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1783138071.886890:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1783138071.886916:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1783138071.887078:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1783138071.887099:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1783138071.887117:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1783138071.887123:0:23475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1783138071.887225:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138071.887290:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138071.890493:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2b0bcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783138071.890539:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175914624 00000100:00100000:0.0:1783138071.890549:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175914624 00000100:00100000:0.0:1783138071.890642:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783138071.890652:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175914624:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138071.890852:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175914624:12345-0@lo:501:mount.lustre.0 Request processed in 201us (3561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.890860:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783138071.890921:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138071.890976:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138071.891027:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138071.891051:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175914752 00000100:00100000:0.0:1783138071.891055:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175914752 00000100:00100000:0.0:1783138071.891078:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783138071.891085:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175914752:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138071.891163:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175914752:12345-0@lo:503:mount.lustre.0 Request processed in 77us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.891169:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783138071.891203:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2b0bcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783138071.891214:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914752:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783138071.893959:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783138071.894053:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138071.894129:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138071.894172:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e028a2540 going to sleep for 11 seconds 00000100:00100000:0.0:1783138071.894199:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175914880 00000100:00100000:0.0:1783138071.894206:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175914880 00000100:00100000:0.0:1783138071.894250:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783138071.894258:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175914880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138071.894522:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175914880:12345-0@lo:502:mount.lustre.0 Request processed in 263us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.894530:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783138071.894588:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175914880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138071.894774:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1783138071.894803:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1783138071.894820:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1783138071.894833:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1783138071.894845:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1783138071.894856:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1783138071.894867:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1783138071.894879:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1783138071.894893:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1783138071.894925:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1783138071.894942:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1783138071.894955:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1783138071.894968:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1783138071.894978:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1783138071.894988:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1783138071.894999:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1783138071.895012:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1783138071.895023:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1783138071.895038:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1783138071.895050:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1783138071.895062:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1783138071.895074:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1783138071.895088:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1783138071.895102:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1783138071.895116:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1783138071.895140:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1783138071.895167:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1783138071.895182:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1783138071.895195:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1783138071.895207:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1783138071.895219:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1783138071.895232:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1783138071.895244:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1783138071.895257:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1783138071.895270:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1783138071.895282:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1783138071.895295:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1783138071.895308:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1783138071.898508:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1783138071.898525:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1783138071.898539:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1783138071.898570:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1783138071.898586:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1783138071.898599:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1783138071.898610:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1783138071.898621:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1783138071.898633:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1783138071.898646:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1783138071.898701:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175915008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138071.898787:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138071.898845:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175915008 00000100:00100000:0.0:1783138071.898854:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175915008 00000100:00100000:0.0:1783138071.898906:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783138071.898916:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175915008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138071.899040:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175915008:12345-0@lo:502:mount.lustre.0 Request processed in 125us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.899057:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783138071.899100:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e028a2540 going to sleep for 11 seconds 00000100:00100000:0.0:1783138071.899121:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175915008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138071.899291:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1783138071.901679:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1783138071.901737:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175915136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138071.901804:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138071.901837:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175915136 00000100:00100000:0.0:1783138071.901843:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175915136 00000100:00100000:0.0:1783138071.901884:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783138071.901892:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175915136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138071.901977:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175915136:12345-0@lo:502:mount.lustre.0 Request processed in 85us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.901984:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783138071.902029:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e028a2540 going to sleep for 11 seconds 00000100:00100000:0.0:1783138071.902045:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175915136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138071.902092:0:23475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1783138071.902099:0:23475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1783138071.903993:0:23493:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1783138071.904010:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9e3e027119c0) 00000020:00000080:0.0:1783138071.904032:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1783138071.905627:0:23493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e3e038cb000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783138071.905635:0:23493:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e3e038cb000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783138071.905639:0:23493:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3e038cb000 3 00010000:00080000:0.0:1783138071.905671:0:23493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3f2afce800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1783138071.912084:0:23493:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1783138071.912217:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1783138071.912272:0:23493:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783138071.912291:0:23493:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x50a9699713c4cd58 00000100:00080000:0.0:1783138071.912302:0:23493:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783138071.912309:0:23493:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e3f2afce800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138071.913512:0:23493:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e03b01c00 x1869755175915264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138071.913547:0:23493:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783138071.913652:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869755175915264:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783138071.913734:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783138071.913831:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138071.913837:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138071.913840:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138071.913850:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1783138071.914127:0:23493:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:0.0:1783138071.914262:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175915264 00000100:00100000:0.0:1783138071.914269:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175915264 00000100:00100000:0.0:1783138071.914308:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000020:01000000:1.0:1783138071.914426:0:23475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783138071.914467:0:23475:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783138071.914483:0:23475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe000/0x50a9699713c4cd43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd4a expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138071.914495:0:23475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3e028fe000/0x50a9699713c4cd43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd4a expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783138071.914544:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783138071.914547:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783138071.914548:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138071.914549:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138071.914551:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138071.914552:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138071.914554:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138071.914555:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138071.914557:0:23475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783138071.914561:0:23475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1783138071.914564:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783138071.914565:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783138071.914567:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138071.914568:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138071.914568:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138071.914570:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138071.914571:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138071.914572:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138071.914572:0:23475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783138071.914592:0:23475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1783138071.914605:0:23475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175915392:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783138071.914657:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.914677:0:23475:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f36581b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783138071.915393:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869755175915264:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783138071.915446:0:22744:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 733 last 0 00000020:00000080:0.0:1783138071.915480:0:22744:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x50a9699713c4cd5f 00000004:00100000:0.0:1783138071.915494:0:22744:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783138071.915524:0:22744:0:(import.c:65:import_set_state_nolock()) ffff9e3f2afcb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138071.915587:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1869755175915264:12345-0@lo:38:llog_process_th.0 Request processed in 197us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.915596:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783138071.915623:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175915392 00000100:00100000:0.0:1783138071.915627:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175915392 00000100:00100000:0.0:1783138071.915657:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783138071.915664:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175915392:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783138071.915687:0:22737:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783138071.915701:0:22737:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1783138071.915837:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e3e03b01c00 x1869755175915264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138071.915859:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783138071.915868:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1783138071.915875:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783138071.915880:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783138071.915883:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f2afce800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783138071.915890:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1869755175915264:0@lo:38:llog_process_th.0 00000001:00100000:2.0:1783138071.922864:0:22722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1783138071.922929:0:22737:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783138071.922942:0:22737:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1783138071.923211:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+18:23475:x1869755175915392:12345-0@lo:253:mount.lustre.0 Request processed in 7541us (8547us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.923223:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 20000000:01000000:2.0:1783138071.923295:0:22758:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783138071.923299:0:22758:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783138071.923350:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923367:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4cc6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cc63 expref: 17 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923375:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3e028fe400/0x50a9699713c4cd2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cd27 expref: 17 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923383:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923419:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3e028fe400/0x50a9699713c4cd2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4cd27 expref: 17 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923445:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3e028fe400/0x50a9699713c4cd2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4cd27 expref: 17 pid: 22737 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138071.923458:0:22758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175915520:0@lo:104: 00000100:00100000:2.0:1783138071.923494:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783138071.923534:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4cc6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4cc63 expref: 17 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923541:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4cc6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4cc63 expref: 17 pid: 22736 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138071.923565:0:22758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175915648:0@lo:104: 00000100:00100000:2.0:1783138071.923588:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138071.923607:0:22758:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0d232780 going to sleep for 11 seconds 00000100:00100000:2.0:1783138071.923626:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175915520 00000100:00100000:2.0:1783138071.923633:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175915520 00000100:00100000:2.0:1783138071.923660:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175915648 00000100:00100000:2.0:1783138071.923663:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175915648 00000100:00100000:2.0:1783138071.923675:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138071.923682:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+4:22758:x1869755175915520:12345-0@lo:104: 00010000:00010000:2.0:1783138071.923694:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923736:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783138071.923742:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+4:22758:x1869755175915520:12345-0@lo:104: Request processed in 61us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138071.923749:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138071.923761:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138071.923767:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+3:22758:x1869755175915648:12345-0@lo:104: 00010000:00010000:2.0:1783138071.923774:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923806:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783138071.923811:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+3:22758:x1869755175915648:12345-0@lo:104: Request processed in 45us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138071.923817:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1783138071.923833:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138071.923839:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923852:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f341ff800 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:2.0:1783138071.923856:0:22730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923864:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138071.923872:0:22730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138071.923878:0:22730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783138071.923905:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923912:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138071.923930:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923936:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff800/0x50a9699713c4cd27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd2e expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923948:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138071.923951:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923957:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479c00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:2.0:1783138071.923960:0:22730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.923975:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138071.923981:0:22730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138071.923986:0:22730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783138071.923999:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924005:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138071.924020:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924026:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4cc63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cc6a expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924038:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138071.924040:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138071.924041:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138071.924047:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138071.924064:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff132a53-abfa-4987-a345-1706880f10ac:3661:1869755175915776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138071.924092:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138071.924122:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175915904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138071.924142:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138071.924177:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175915776 00000100:00100000:2.0:1783138071.924181:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175915776 00010000:00010000:2.0:1783138071.924195:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3e028fe400/0x50a9699713c4cd2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cd27 expref: 18 pid: 22737 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138071.924220:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175915904 00000100:00100000:2.0:1783138071.924223:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175915904 00010000:00010000:2.0:1783138071.924232:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4cc6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cc63 expref: 19 pid: 22736 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138071.924242:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138071.924246:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+19:3661:x1869755175915776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138071.924255:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138071.924260:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3e028fe400/0x50a9699713c4cd2e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cd27 expref: 19 pid: 22737 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924269:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3e028fe400/0x50a9699713c4cd2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4cd27 expref: 19 pid: 22737 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924283:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138071.924307:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+19:3661:x1869755175915776:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138071.924343:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783138071.924355:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138071.924361:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+18:3658:x1869755175915904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138071.924368:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138071.924372:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4cc6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cc63 expref: 18 pid: 22736 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924381:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4cc6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4cc63 expref: 18 pid: 22736 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924392:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924407:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783138071.924419:0:22728:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004365398s 00010000:00010000:2.0:1783138071.924423:0:22728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924443:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924451:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924457:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924463:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479400 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138071.924467:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924475:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924483:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924492:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138071.924521:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+18:3658:x1869755175915904:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138071.924528:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138071.924571:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175915904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138071.924594:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff132a53-abfa-4987-a345-1706880f10ac:3661:1869755175915776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138071.924611:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028fe400/0x50a9699713c4cd2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4cd27 expref: 17 pid: 22737 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138071.924621:0:22758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175915520:0@lo:104: 00010000:00010000:2.0:1783138071.924630:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4cc6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4cc63 expref: 16 pid: 22736 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138071.924637:0:22758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175915648:0@lo:104: 00010000:00010000:2.0:1783138071.924649:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924657:0:22758:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924662:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138071.924668:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4cd66 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138071.924903:0:23475:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:23475:1869755175915392:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783138071.924914:0:23475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1783138071.924918:0:23475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783138071.924919:0:23475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783138071.924921:0:23475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138071.924922:0:23475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138071.924924:0:23475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138071.924925:0:23475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138071.924927:0:23475:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783138071.924929:0:23475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138071.924930:0:23475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783138071.924943:0:23475:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:1.0:1783138071.928214:0:23475:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1783138071.928283:0:23499:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1783138071.928287:0:23499:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1783138071.928586:0:23500:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1783138071.928910:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1783138071.929427:0:23475:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1783138071.929810:0:23501:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1869755175916032:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783138071.929883:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.929920:0:23501:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f03945540 going to sleep for 11 seconds 00000040:01000000:3.0:1783138071.930082:0:23475:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1783138071.930119:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783138071.931719:0:23475:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783138071.931743:0:23475:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1783138071.931831:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783138071.932503:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175916032 00000100:00100000:0.0:1783138071.932515:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175916032 00000100:00100000:0.0:1783138071.932567:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783138071.932576:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23501:x1869755175916032:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783138071.932695:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23501:x1869755175916032:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 120us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.932703:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138071.933812:0:23501:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1869755175916032:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1783138071.933860:0:23501:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783138071.933906:0:23501:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1869755175916160:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783138071.933961:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138071.933995:0:23501:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f03945540 going to sleep for 11 seconds 00000040:00080000:3.0:1783138071.938110:0:23475:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783138071.938758:0:23475:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783138071.938794:0:23475:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1783138071.938906:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783138071.939531:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175916160 00000100:00100000:0.0:1783138071.939543:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175916160 00000100:00100000:0.0:1783138071.939598:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138071.939608:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23501:x1869755175916160:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783138071.939771:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23501:x1869755175916160:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 164us (5809us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.939779:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138071.939829:0:23501:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1869755175916160:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783138071.939908:0:23501:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23501:1869755175916288:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1783138071.939943:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138071.939980:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175916288 00000100:00100000:0.0:1783138071.939984:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175916288 00000100:00100000:0.0:1783138071.940005:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783138071.940012:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23501:x1869755175916288:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1783138071.940043:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23501:x1869755175916288:12345-0@lo:900:lod0001_rec0000.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.940049:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783138071.940066:0:23501:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e028a2540 going to sleep for 11 seconds 00010000:00080000:0.0:1783138071.940078:0:23501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e3e03b01c00 x1869755175916288/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783138087 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138071.940088:0:23501:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23501:1869755175916288:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1783138071.940132:0:23501:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1869755175916416:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783138071.940171:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138071.940189:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175916416 00000100:00100000:0.0:1783138071.940192:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175916416 00000100:00100000:0.0:1783138071.940207:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138071.940212:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23501:x1869755175916416:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1783138071.940256:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23501:x1869755175916416:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 43us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138071.940261:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138071.940275:0:23501:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e01e05b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783138071.940288:0:23501:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23501:1869755175916416:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1783138071.940360:0:23501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783138071.941563:0:23500:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783138071.941651:0:23500:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00080000:10000000:3.0:1783138071.946717:0:23475:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:0.0:1783138071.950773:0:23501:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783138071.950846:0:23501:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783138071.950851:0:23501:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1783138071.951773:0:23475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1783138071.953561:0:23475:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783138071.953692:0:23475:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbaa8c1c5b988 00100000:10000000:2.0:1783138071.953702:0:23475:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1783138071.954906:0:23475:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783138071.954939:0:23475:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783138071.954956:0:23475:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783138071.954990:0:23475:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1783138071.956947:0:23475:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783138071.957237:0:23475:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783138072.377741:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138072.762939:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00000040:00080000:3.0:1783138072.955882:0:23496:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1783138073.401616:0:22739:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783138073.401633:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9e3e038cb000 from 12 10000000:01000000:3.0:1783138073.401639:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783138073.401690:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138073.401702:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138073.401712:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138073.401737:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a985f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175916544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783138073.401809:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138073.401846:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e03b37240 going to sleep for 11 seconds 00010000:00010000:3.0:1783138073.401990:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138073.403546:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175916544 00000100:00100000:0.0:1783138073.403559:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175916544 00000100:00100000:0.0:1783138073.403637:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783138073.403655:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2c42a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+16:22739:x1869755175916544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138073.403672:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138073.403690:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e028fea00/0x50a9699713c4cd74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cd6d expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138073.403715:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028fea00/0x50a9699713c4cd74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cd6d expref: 17 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138073.403727:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e028fea00/0x50a9699713c4cd74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cd6d expref: 17 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138073.403736:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028fea00, rc 0) 00000100:00100000:0.0:1783138073.403813:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2c42a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+17:22739:x1869755175916544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138073.403819:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783138073.404161:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a985f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175916544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138073.404183:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138073.404193:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138073.404263:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a985f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175916672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783138073.404768:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138073.404803:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e03b37240 going to sleep for 11 seconds 00000100:00100000:0.0:1783138073.405950:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175916672 00000100:00100000:0.0:1783138073.405962:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175916672 00000100:00100000:0.0:1783138073.406018:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783138073.406027:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2c42a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+17:22739:x1869755175916672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783138073.406050:0:22737:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783138073.406067:0:22737:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783138073.406074:0:22737:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1783138073.406184:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2c42a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+17:22739:x1869755175916672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138073.406191:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783138073.406817:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a985f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175916672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783138073.406881:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783138073.406897:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138073.406908:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138073.406918:0:22739:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783138073.406922:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9e3f3625b800 from 12 10000000:01000000:3.0:1783138073.406925:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783138073.406974:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138073.406983:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138073.406992:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138073.407012:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a985f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175916800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783138073.407058:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138073.407100:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e03b37240 going to sleep for 11 seconds 00000100:00100000:0.0:1783138073.407563:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175916800 00000100:00100000:0.0:1783138073.407571:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175916800 00000100:00100000:0.0:1783138073.407611:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783138073.407619:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2c429c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+17:22739:x1869755175916800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138073.407640:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138073.408610:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e028ff600/0x50a9699713c4cd82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cd7b expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138073.408728:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028ff600/0x50a9699713c4cd82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cd7b expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138073.408741:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e028ff600/0x50a9699713c4cd82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cd7b expref: 18 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138073.408750:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028ff600, rc 0) 00000100:00100000:0.0:1783138073.408839:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2c429c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:22739:x1869755175916800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1219us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138073.408847:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783138073.409204:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a985f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175916800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138073.409227:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138073.409238:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138073.409353:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175916928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783138073.409401:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138073.409454:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a86dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138073.410059:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175916928 00000100:00100000:0.0:1783138073.410067:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175916928 00000100:00100000:0.0:1783138073.410119:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783138073.410128:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+18:22739:x1869755175916928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783138073.410150:0:22735:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783138073.410169:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783138073.410173:0:22735:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1783138073.410284:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+18:22739:x1869755175916928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 155us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138073.411080:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175916928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783138073.411141:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783138073.411151:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138073.411161:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138073.412448:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783138073.786914:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00000040:00080000:3.0:1783138073.982084:0:23496:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783138074.426242:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138074.810437:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783138075.449494:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138075.834176:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00010000:00010000:0.0:1783138076.474496:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783138076.591085:0:23744:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1783138076.860554:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 0 seconds 00000100:00100000:0.0:1783138077.049917:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175917056:0@lo:400:kworker.0 00000100:00100000:0.0:1783138077.049987:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783138077.050592:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783138077.050598:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783138077.050601:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138077.050609:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e3e0413b000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138077.050635:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f3f48e300 x1869755175917184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138077.050650:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138077.050653:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138077.050656:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138077.050658:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138077.050680:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138077.050683:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138077.050685:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138077.050688:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783138077.051547:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175917184:0@lo:38:kworker.0 00000100:00100000:3.0:1783138077.051615:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138077.051836:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175917184 00000100:00100000:1.0:1783138077.051845:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175917184 00000100:00100000:1.0:1783138077.051889:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783138077.051896:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1869755175917184:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783138077.051925:0:22748:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 738 last 0 00000020:00000080:1.0:1783138077.051959:0:22748:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50a9699713c4cd89 00000004:00100000:1.0:1783138077.051974:0:22748:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1783138077.051981:0:22748:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1783138077.053720:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175917056 00000100:00100000:0.0:1783138077.053734:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175917056 00000100:00100000:0.0:1783138077.053796:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783138077.053806:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:3659:x1869755175917056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138077.053880:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:3659:x1869755175917056:12345-0@lo:400:kworker.0 Request processed in 76us (3894us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138077.053887:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783138077.053929:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175917056:0@lo:400:kworker.0 00000100:00100000:0.0:1783138077.053948:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138077.053956:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869755175917568:0@lo:400:kworker.0 00000100:00100000:0.0:1783138077.053984:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138077.054130:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175917568 00000100:00100000:3.0:1783138077.054135:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175917568 00000100:00100000:3.0:1783138077.054196:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783138077.054203:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869755175917568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138077.054248:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869755175917568:12345-0@lo:400:kworker.0 Request processed in 46us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138077.054254:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783138077.054284:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e3f3f48f480 x1869755175917568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138077.054296:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869755175917568:0@lo:400:kworker.0 00000100:00100000:2.0:1783138077.056387:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175917312:0@lo:400:kworker.0 00000100:00100000:2.0:1783138077.056490:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138077.056531:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783138077.056538:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175917440:0@lo:400:kworker.0 00000100:00100000:2.0:1783138077.056567:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138077.056604:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175917312 00000100:00100000:2.0:1783138077.056611:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175917312 00000100:00100000:2.0:1783138077.056651:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138077.056659:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175917312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138077.057370:0:22747:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1783138077.057382:0:22747:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1783138077.057853:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175917312:12345-0@lo:400:kworker.0 Request processed in 1191us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138077.057863:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783138077.057946:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e3f3f48ca80 x1869755175917312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138077.057961:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175917312:0@lo:400:kworker.0 00000100:00100000:1.0:1783138077.059355:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783138077.059373:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175917696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138077.059436:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783138077.067630:0:22748:0:(import.c:65:import_set_state_nolock()) ffff9e3f2afca000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138077.067751:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1869755175917184:12345-0@lo:38:kworker.0 Request processed in 15852us (16134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138077.067764:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783138077.067790:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175917440 00000100:00100000:0.0:1783138077.067796:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175917440 00000100:00100000:0.0:1783138077.067823:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175917696 00000100:00100000:0.0:1783138077.067826:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175917696 00000100:00100000:0.0:1783138077.067840:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783138077.067846:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3660:x1869755175917440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138077.067909:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3660:x1869755175917440:12345-0@lo:400:kworker.0 Request processed in 62us (11340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138077.067916:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783138077.067929:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138077.067936:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175917696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783138077.067958:0:22748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783138077.067988:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175917696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (8553us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138077.067994:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138077.068035:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175917440:0@lo:400:kworker.0 00000100:00100000:1.0:1783138077.068345:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175917696:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1783138077.068380:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1783138077.068399:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783138077.068406:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783138077.068408:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e0413b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1783138077.068425:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d1127191): req@ffff9e3f3f48d180 x1869755175910272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138077.068451:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175917184:0@lo:38:kworker.0 00000100:00100000:1.0:1783138077.068527:0:22784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138077.068549:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e037559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138077.068560:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175910272 00000100:00100000:1.0:1783138077.068564:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175910272 00000100:00100000:1.0:1783138077.068583:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783138077.068590:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22784:x1869755175910272:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783138077.068651:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22784:x1869755175910272:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 61us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138077.068658:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783138077.068681:0:22784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22784:1869755175910272:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1783138077.068720:0:22784:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783138077.068760:0:22784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22784:1869755175917824:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783138077.068788:0:22784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138077.068801:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e01f799c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138077.068811:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175917824 00000100:00100000:1.0:1783138077.068815:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175917824 00000100:00100000:1.0:1783138077.068831:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783138077.068837:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22784:x1869755175917824:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783138077.068934:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22784:x1869755175917824:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 97us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138077.068940:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783138077.068962:0:22784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22784:1869755175917824:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783138077.069033:0:22784:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22784:1869755175917952:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783138077.069055:0:22784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138077.069069:0:22784:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e01f799c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138077.069079:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175917952 00000100:00100000:1.0:1783138077.069082:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175917952 00000100:00100000:1.0:1783138077.069098:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783138077.069104:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22784:x1869755175917952:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783138077.069577:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22784:x1869755175917952:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 471us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138077.069584:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783138077.069614:0:22784:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22784:1869755175917952:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1783138077.069660:0:22784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783138077.071818:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175918080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783138077.071885:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783138077.081217:0:22784:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783138077.081304:0:22784:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1783138077.081308:0:22784:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1783138077.081463:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175918080 00000100:00100000:1.0:1783138077.081538:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175918080 00000100:00100000:1.0:1783138077.081595:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783138077.081606:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1869755175918080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783138077.081645:0:22748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783138077.081734:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1869755175918080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (9849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138077.081752:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783138077.081865:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175918080:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783138077.504738:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783138077.512554:0:23797:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783138077.512938:0:23797:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783138078.526553:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783138078.543689:0:23847:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783138078.543908:0:23847:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783138079.545539:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783138079.867112:0:22776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1783138079.870912:0:23895:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe612c91f0 20000000:00000080:3.0:1783138079.870931:0:23895:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e3f043b8000 uarg=0000000000000000 20000000:01000000:3.0:1783138079.870977:0:23895:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783138079.870986:0:23895:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783138079.870991:0:23895:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783138079.871922:0:23896:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1783138079.872154:0:23895:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783138079.880887:0:23895:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783138079.880917:0:23895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138079.880954:0:23895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3e028fe600/0x50a9699713c4cc39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cc32 expref: 17 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138079.880961:0:23895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3f341fea00/0x50a9699713c4cd3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cd35 expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138079.880968:0:23895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138079.881080:0:23895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3f341fea00/0x50a9699713c4cd3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4cd35 expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138079.881096:0:23895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3f341fea00/0x50a9699713c4cd3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4cd35 expref: 17 pid: 22735 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138079.881111:0:23895:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a984000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23895:1869755175918208:0@lo:104: 00000100:00100000:3.0:1783138079.881174:0:23895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783138079.881837:0:23895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3e028fe600/0x50a9699713c4cc39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4cc32 expref: 17 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138079.881848:0:23895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3e028fe600/0x50a9699713c4cc39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4cc32 expref: 17 pid: 22737 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138079.881859:0:23895:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23895:1869755175918336:0@lo:104: 00000100:00100000:3.0:1783138079.881888:0:23895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138079.882517:0:23895:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f18247d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783138079.882919:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175918208 00000100:00100000:0.0:1783138079.882927:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175918208 00000100:00100000:1.0:1783138079.882987:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175918336 00000100:00100000:1.0:1783138079.882992:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175918336 00000100:00100000:1.0:1783138079.883028:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138079.883038:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a984a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+4:23895:x1869755175918208:12345-0@lo:104: 00010000:00010000:1.0:1783138079.883052:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138079.883178:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783138079.883184:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a984a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+4:23895:x1869755175918208:12345-0@lo:104: Request processed in 148us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138079.883191:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138079.883210:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783138079.883216:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+3:23895:x1869755175918336:12345-0@lo:104: 00010000:00010000:1.0:1783138079.883223:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138079.883790:0:23895:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a984000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23895:1869755175918208:0@lo:104: 00000100:00100000:3.0:1783138079.883803:0:23895:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23895:1869755175918336:0@lo:104: 00010000:00010000:3.0:1783138079.883833:0:23895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138079.884236:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138079.884245:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138079.884421:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479a00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:2.0:1783138079.884427:0:22730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138079.884439:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138079.884447:0:22730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138079.884453:0:22730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783138079.884601:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138079.884620:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138079.884645:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138079.884652:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479a00/0x50a9699713c4cd35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd3c expref: -99 pid: 23475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138079.884667:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138079.884670:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138079.884675:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028fee00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:2.0:1783138079.884678:0:22730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138079.884685:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138079.884691:0:22730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138079.884696:0:22730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1783138079.884750:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff132a53-abfa-4987-a345-1706880f10ac:3661:1869755175918464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138079.884804:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138079.884863:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175918464 00000100:00100000:0.0:1783138079.884868:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175918464 00010000:00010000:0.0:1783138079.884891:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3f341fea00/0x50a9699713c4cd3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cd35 expref: 18 pid: 22735 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138079.884916:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783138079.884923:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff132a53-abfa-4987-a345-1706880f10ac+18:3661:x1869755175918464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138079.884944:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138079.884950:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3f341fea00/0x50a9699713c4cd3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cd35 expref: 18 pid: 22735 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.884962:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3f341fea00/0x50a9699713c4cd3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4cd35 expref: 18 pid: 22735 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.884975:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f341fea00/0x50a9699713c4cd3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4cd35 expref: 18 pid: 22735 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.884988:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138079.885032:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff132a53-abfa-4987-a345-1706880f10ac+17:3661:x1869755175918464:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138079.885038:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783138079.885070:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff132a53-abfa-4987-a345-1706880f10ac:3661:1869755175918464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138079.885283:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1783138079.885293:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+3:23895:x1869755175918336:12345-0@lo:104: Request processed in 2075us (3402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138079.885300:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1783138079.886155:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138079.888764:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138079.888780:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138079.888812:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138079.888820:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e028fee00/0x50a9699713c4cc32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cc39 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138079.888856:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138079.888858:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138079.888861:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138079.890442:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138079.890479:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175918592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138079.890549:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138079.898819:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175918592 00000100:00100000:2.0:1783138079.898836:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175918592 00010000:00010000:0.0:1783138079.898983:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3e028fe600/0x50a9699713c4cc39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cc32 expref: 17 pid: 22737 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138079.899059:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783138079.899070:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+17:3659:x1869755175918592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138079.899088:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138079.899095:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3e028fe600/0x50a9699713c4cc39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cc32 expref: 17 pid: 22737 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899127:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3e028fe600/0x50a9699713c4cc39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4cc32 expref: 17 pid: 22737 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899146:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028fe600/0x50a9699713c4cc39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4cc32 expref: 17 pid: 22737 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899164:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899172:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899189:0:22728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899196:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899203:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899210:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899216:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f00031400 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138079.899220:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899226:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899257:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138079.899268:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138079.899379:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+16:3659:x1869755175918592:12345-0@lo:103:ldlm_bl.0 Request processed in 302us (8820us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138079.899387:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783138079.899426:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175918592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783138079.899497:0:23895:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138079.899505:0:23895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138079.899512:0:23895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f00031400/0x50a9699713c4cd90 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138080.580659:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783138081.147135:0:22739:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783138081.147144:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9e3e038cb000 from 13 10000000:01000000:1.0:1783138081.147149:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783138081.147201:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138081.147232:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138081.147243:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138081.147270:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175918720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783138081.147382:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138081.147416:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e01f79e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783138081.147475:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175918720 00000100:00100000:0.0:1783138081.147483:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175918720 00000100:00100000:0.0:1783138081.147539:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783138081.147548:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+16:22739:x1869755175918720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138081.147562:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138081.147577:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e028ffa00/0x50a9699713c4cd9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cd97 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138081.147600:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028ffa00/0x50a9699713c4cd9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cd97 expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138081.147610:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e028ffa00/0x50a9699713c4cd9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cd97 expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138081.147619:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028ffa00, rc 0) 00000100:00100000:0.0:1783138081.147662:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+17:22739:x1869755175918720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138081.147668:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783138081.148250:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175918720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138081.148269:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138081.148280:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138081.148408:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175918848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138081.148447:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138081.148475:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e01f79e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783138081.148533:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175918848 00000100:00100000:0.0:1783138081.148538:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175918848 00000100:00100000:0.0:1783138081.148578:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783138081.148586:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+17:22739:x1869755175918848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138081.148704:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+17:22739:x1869755175918848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138081.148711:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783138081.148916:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175918848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138081.148946:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175918976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138081.148990:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138081.149010:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e01f79e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783138081.149148:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175918976 00000100:00100000:0.0:1783138081.149153:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175918976 00000100:00100000:0.0:1783138081.149187:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783138081.149195:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+17:22739:x1869755175918976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783138081.149275:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+17:22739:x1869755175918976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138081.149282:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783138081.149413:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175918976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783138081.151505:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138071/real 1783138071] req@ffff9e3e03b02d80 x1869755175913472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138081 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138081.151534:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3e03b02d80 x1869755175913472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138081 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138081.151545:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138071/real 1783138071] req@ffff9e3f2f881c00 x1869755175913344/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138081 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138081.151557:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3f2f881c00 x1869755175913344/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138081 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783138081.151576:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138081.151593:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783138081.151597:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175913472:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783138081.151602:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f0af9d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138081.151608:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783138081.151611:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175913344:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783138081.152537:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138081.152542:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783138081.152544:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138081.152558:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783138081.152587:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783138081.152603:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869755175919232:0@lo:400:kworker.0 00000100:00100000:2.0:1783138081.152667:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138081.152708:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175919232 00000100:00100000:2.0:1783138081.152714:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175919232 00000100:00100000:2.0:1783138081.152759:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138081.152768:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869755175919232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138081.152824:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869755175919232:12345-0@lo:400:kworker.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138081.152831:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783138081.152873:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e3f3f48ca80 x1869755175919232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138081.152886:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869755175919232:0@lo:400:kworker.0 00000100:00100000:0.0:1783138081.153044:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175919104:0@lo:400:kworker.0 00000100:00100000:0.0:1783138081.153080:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783138081.153679:0:23955:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00080000:0.0:1783138081.154459:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138081.154465:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783138081.154468:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e3f0af9d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138081.154475:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 733 00000100:00080000:0.0:1783138081.154480:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783138081.154485:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e3f0af9d000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138081.154493:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783138081.154507:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175919360:0@lo:400:kworker.0 00000100:00100000:0.0:1783138081.154557:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138081.154615:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e03b02d80 x1869755175919488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138081.154632:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138081.154636:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783138081.154637:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138081.154640:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 733 00000100:00080000:0.0:1783138081.154642:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783138081.154647:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e3f340c6000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138081.154657:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e03b03480 x1869755175919616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783138081.154686:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138081.154694:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869755175919744:0@lo:400:kworker.0 00000100:00100000:0.0:1783138081.154720:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138081.158484:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175919744 00000100:00100000:2.0:1783138081.158500:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175919744 00000100:00100000:2.0:1783138081.158569:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783138081.158580:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869755175919744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138081.158686:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869755175919744:12345-0@lo:400:kworker.0 Request processed in 107us (3963us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138081.158693:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783138081.158746:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e3e03b02a00 x1869755175919744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138081.158762:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869755175919744:0@lo:400:kworker.0 00000100:00100000:2.0:1783138081.158809:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175919488:0@lo:8:kworker.0 00000400:00000100:2.0:1783138081.158853:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755175919488 offset 0 length 520: 4 00000100:00100000:2.0:1783138081.158879:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175919616:0@lo:8:kworker.0 00000400:00000100:2.0:1783138081.158899:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755175919616 offset 0 length 520: 4 00000100:00100000:2.0:1783138081.158944:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175919104 00000100:00100000:2.0:1783138081.158949:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175919104 00000100:00100000:2.0:1783138081.158974:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175919360 00000100:00100000:2.0:1783138081.158978:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175919360 00000100:00100000:2.0:1783138081.158990:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783138081.158996:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1869755175919104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138081.159031:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1869755175919104:12345-0@lo:400:kworker.0 Request processed in 35us (5950us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138081.159037:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783138081.159047:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783138081.159052:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175919360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138081.159082:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175919360:12345-0@lo:400:kworker.0 Request processed in 30us (4525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138081.159088:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783138081.159113:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175919104:0@lo:400:kworker.0 00000100:00100000:2.0:1783138081.159136:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175919360:0@lo:400:kworker.0 00000020:01000000:1.0:1783138081.159272:0:22739:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783138081.159328:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783138081.159341:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138081.159352:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138081.159370:0:22739:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783138081.159373:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9e3f3625b800 from 13 10000000:01000000:1.0:1783138081.159376:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783138081.159407:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138081.159416:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138081.159426:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138081.159444:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175919872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783138081.159477:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138081.159502:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e01f79e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783138081.159519:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175919872 00000100:00100000:1.0:1783138081.159523:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175919872 00000100:00100000:1.0:1783138081.159551:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783138081.159558:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+17:22739:x1869755175919872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138081.159567:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138081.159579:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f341ff800/0x50a9699713c4cdac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cda5 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138081.159612:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f341ff800/0x50a9699713c4cdac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cda5 expref: 18 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138081.159622:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f341ff800/0x50a9699713c4cdac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cda5 expref: 18 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138081.159632:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f341ff800, rc 0) 00000100:00100000:1.0:1783138081.159662:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+18:22739:x1869755175919872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138081.159668:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783138081.159705:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175919872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138081.159718:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138081.159727:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138081.159777:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175920000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138081.159802:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138081.159815:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e01f79e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783138081.159829:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175920000 00000100:00100000:1.0:1783138081.159832:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175920000 00000100:00100000:1.0:1783138081.159853:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783138081.159860:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+18:22739:x1869755175920000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138081.159980:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+18:22739:x1869755175920000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138081.159997:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783138081.160029:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175920000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138081.160054:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175920128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138081.160094:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138081.160108:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e01f79e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783138081.160120:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175920128 00000100:00100000:1.0:1783138081.160124:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175920128 00000100:00100000:1.0:1783138081.160144:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783138081.160151:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:22739:x1869755175920128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138081.160238:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:22739:x1869755175920128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138081.160244:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783138081.160283:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175920128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783138081.160995:0:23957:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783138081.161050:0:22739:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783138081.161069:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783138081.161076:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138081.161085:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138081.593512:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138082.169696:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175920256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138082.169764:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138082.169821:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175920256 00000100:00100000:1.0:1783138082.169837:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175920256 00000100:00100000:1.0:1783138082.169882:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783138082.169891:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175920256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783138082.169935:0:23767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783138082.169982:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175920256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138082.169990:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783138082.170034:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175920256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138082.170779:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783138082.170793:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175920384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783138082.170833:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138082.170867:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175920384 00000100:00100000:1.0:1783138082.170873:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175920384 00000100:00100000:1.0:1783138082.175504:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783138082.175545:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1869755175920384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783138082.175589:0:22748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783138082.175679:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1869755175920384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (4845us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138082.176050:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138067/real 1783138067] req@ffff9e3f3f48d880 x1869755175911296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138082 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138082.176071:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3f3f48d880 x1869755175911296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138082 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138082.176098:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138067/real 1783138067] req@ffff9e3f3f48fb80 x1869755175911424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138082 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138082.176110:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3f3f48fb80 x1869755175911424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138082 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783138082.176127:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e038b4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138082.176145:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783138082.176148:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175911296:0@lo:8:kworker.0 00000100:00080000:2.0:1783138082.176153:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f1f987800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138082.176158:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783138082.176161:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175911424:0@lo:8:kworker.0 00000100:00100000:0.0:1783138082.176637:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175920384:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1783138082.176701:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138082.176705:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783138082.176708:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3e038b4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138082.176712:0:16974:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 729 00000100:00100000:2.0:1783138082.176714:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1783138082.176716:0:16974:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783138082.176722:0:16974:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e3e038b4800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138082.176726:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175920512:0@lo:400:kworker.0 00000100:00100000:0.0:1783138082.176741:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e03b02a00 x1869755175920640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138082.176755:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138082.176757:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783138082.176766:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3f1f987800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138082.176769:0:16974:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 729 00000100:00080000:0.0:1783138082.176771:0:16974:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783138082.176775:0:16974:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e3f1f987800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138082.176778:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138082.176787:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e04333b80 x1869755175920768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138082.176808:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138082.176812:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138082.176815:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138082.176818:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783138082.176840:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175920640:0@lo:8:kworker.0 00000100:00100000:2.0:1783138082.176850:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175920512 00000100:00100000:2.0:1783138082.176857:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175920512 00000400:00000100:0.0:1783138082.176866:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755175920640 offset 0 length 520: 4 00000100:00100000:0.0:1783138082.176880:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175920768:0@lo:8:kworker.0 00000400:00000100:0.0:1783138082.176894:0:3657:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869755175920768 offset 0 length 520: 4 00000100:00100000:2.0:1783138082.176914:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783138082.176922:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+18:3660:x1869755175920512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138082.176964:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+18:3660:x1869755175920512:12345-0@lo:400:kworker.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138082.176972:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783138082.176990:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869755175921024:0@lo:400:kworker.0 00000100:00100000:2.0:1783138082.177002:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175920896:0@lo:400:kworker.0 00000100:00100000:0.0:1783138082.177017:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138082.177034:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175920512:0@lo:400:kworker.0 00000100:00100000:0.0:1783138082.177048:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175921024 00000100:00100000:0.0:1783138082.177051:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175921024 00000100:00100000:2.0:1783138082.177057:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138082.177075:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175920896 00000100:00100000:0.0:1783138082.177078:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175920896 00000100:00100000:0.0:1783138082.177091:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138082.177097:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869755175921024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138082.177108:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783138082.177115:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783138082.177132:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869755175921024:12345-0@lo:400:kworker.0 Request processed in 35us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138082.177137:0:22744:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783138082.177144:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783138082.177148:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138082.177150:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175920896:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1783138082.177174:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e3e04331880 x1869755175921024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138082.177181:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175920896:12345-0@lo:400:kworker.0 Request processed in 31us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138082.177184:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869755175921024:0@lo:400:kworker.0 00000100:00100000:2.0:1783138082.177187:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783138082.177208:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e3e04330e00 x1869755175920896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138082.177216:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175920896:0@lo:400:kworker.0 00000100:00100000:1.0:1783138082.178123:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1783138082.618780:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783138083.195057:0:23496:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1783138083.204697:0:23476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1783138083.645478:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138084.668880:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138085.689797:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138086.714585:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783138087.106403:0:24244:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783138087.106407:0:24244:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783138087.106408:0:24244:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783138087.106521:0:24244:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e3f043b6000 00000020:01000004:1.0:1783138087.106535:0:24244:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783138087.106548:0:24244:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783138087.106561:0:24244:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e3f2a8399c0) 00000020:00000080:1.0:1783138087.106576:0:24244:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783138087.196054:0:24244:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783138087.197760:0:24244:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783138087.198123:0:24244:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783138087.198480:0:24244:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783138087.198938:0:24244:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783138087.199272:0:24244:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783138087.199519:0:24244:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1783138087.209715:0:24244:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783138087.209944:0:24244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783138087.209957:0:24244:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783138087.209968:0:24244:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x50a9699713c4cdba 00000020:01000004:3.0:1783138087.209975:0:24244:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783138087.209993:0:24244:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783138087.209997:0:24244:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783138087.210002:0:24244:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783138087.210006:0:24244:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783138087.210017:0:24244:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e3f1f9f0000) 00000020:00000080:3.0:1783138087.210026:0:24244:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1783138087.214716:0:24244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783138087.214919:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783138087.214926:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1783138087.220066:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1783138087.220095:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1783138087.222352:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1783138087.222366:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783138087.231292:0:24244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783138087.231532:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783138087.231539:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783138087.237559:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783138087.237570:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783138087.275569:0:24244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783138087.275808:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783138087.275817:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1783138087.277781:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783138087.277795:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783138087.282623:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783138087.282647:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783138087.286627:0:24244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783138087.286807:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783138087.286813:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783138087.287837:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783138087.287846:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00080000:0.0:1783138087.289540:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.289547:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138087.289550:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.289553:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138087.289575:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.289578:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138087.289580:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.289584:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783138087.289639:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175921152:0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.289715:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138087.291097:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175921664:0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.291167:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138087.291228:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783138087.291235:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175921280:0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.291260:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138087.291285:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175921792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783138087.291297:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175921664 00000100:00100000:0.0:1783138087.291303:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138087.291305:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175921664 00000100:00100000:0.0:1783138087.291357:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175921408:0@lo:400:kworker.0 00000100:00100000:2.0:1783138087.291371:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138087.291381:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175921664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.291381:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138087.291397:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783138087.291404:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175921536:0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.291422:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138087.291435:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175921664:12345-0@lo:400:kworker.0 Request processed in 56us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138087.291442:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138087.291449:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175921152 00000100:00100000:0.0:1783138087.291453:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175921152 00000100:00100000:2.0:1783138087.291456:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175921408 00000100:00100000:2.0:1783138087.291458:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175921408 00000100:00100000:2.0:1783138087.291474:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138087.291478:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783138087.291480:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175921408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.291483:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0285c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+18:3660:x1869755175921152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.291508:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0285c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+18:3660:x1869755175921152:12345-0@lo:400:kworker.0 Request processed in 24us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138087.291509:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175921408:12345-0@lo:400:kworker.0 Request processed in 30us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.291514:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783138087.291515:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138087.291537:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175921280 00000100:00100000:0.0:1783138087.291540:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175921280 00000100:00100000:0.0:1783138087.291556:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175921792 00000100:00100000:0.0:1783138087.291558:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175921792 00000100:00100000:0.0:1783138087.291566:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175921536 00000100:00100000:0.0:1783138087.291568:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175921536 00000100:00100000:0.0:1783138087.291580:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783138087.291586:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1869755175921280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.291618:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1869755175921280:12345-0@lo:400:kworker.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.291624:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783138087.291643:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783138087.291648:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175921792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783138087.291671:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783138087.291703:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175921792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.291709:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783138087.291718:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783138087.291723:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175921536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.291747:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175921536:12345-0@lo:400:kworker.0 Request processed in 23us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.291752:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783138087.291800:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175921536:0@lo:400:kworker.0 00010000:00080000:0.0:1783138087.291814:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e3e04332a00 x1869755175921408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138087.291824:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175921408:0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.291852:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175921280:0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.291865:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175921792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783138087.291873:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175921152:0@lo:400:kworker.0 00010000:00080000:0.0:1783138087.291882:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e3e04331500 x1869755175921664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138087.291891:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175921664:0@lo:400:kworker.0 00000100:00100000:0.0:1783138087.293540:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175921920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138087.293621:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138087.295063:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175921920 00000100:00100000:1.0:1783138087.295078:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175921920 00000100:00100000:2.0:1783138087.295464:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783138087.295477:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175921920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783138087.295523:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783138087.295620:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175921920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138087.295629:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783138087.295895:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175921920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783138087.330820:0:24244:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783138087.331026:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783138087.331032:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783138087.332818:0:24244:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783138087.332832:0:24244:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783138087.333280:0:24244:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783138087.333442:0:24244:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783138087.333448:0:24244:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783138087.352023:0:24244:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783138087.352084:0:24244:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783138087.352088:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783138087.352089:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783138087.352091:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138087.352092:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138087.352093:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138087.352094:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138087.352100:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138087.352101:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138087.352103:0:24244:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783138087.352106:0:24244:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783138087.352108:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783138087.352109:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783138087.352110:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138087.352111:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138087.352112:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138087.352113:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138087.352114:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138087.352115:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138087.352115:0:24244:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783138087.352149:0:24244:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783138087.352170:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922048:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783138087.352247:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138087.352301:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0b347c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138087.352340:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175922048 00000100:00100000:1.0:1783138087.352348:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175922048 00000100:00100000:1.0:1783138087.352414:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783138087.352424:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0285f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:24244:x1869755175922048:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783138087.352455:0:22736:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783138087.352459:0:22736:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1783138087.352462:0:22736:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783138087.352701:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0285f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:24244:x1869755175922048:12345-0@lo:253:mount.lustre.0 Request processed in 278us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138087.352709:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783138087.352790:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783138087.352798:0:24244:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783138087.352800:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783138087.352801:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783138087.352802:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138087.352803:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138087.352804:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138087.352805:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138087.352806:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138087.352807:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138087.352808:0:24244:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783138087.352824:0:24244:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e3f043b6000 from lustre-OST0000 10000000:01000000:2.0:1783138087.352857:0:24244:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783138087.352860:0:24244:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783138087.352868:0:24244:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e3f0445cd40 local copy 00010000:00010000:2.0:1783138087.352879:0:24244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138087.352955:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138087.352990:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138087.353019:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0b347480 going to sleep for 11 seconds 00000100:00100000:0.0:1783138087.353070:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175922176 00000100:00100000:0.0:1783138087.353075:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175922176 00000100:00100000:0.0:1783138087.353109:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783138087.353117:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0285dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+18:24244:x1869755175922176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138087.353189:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0285dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+18:24244:x1869755175922176:12345-0@lo:501:mount.lustre.0 Request processed in 72us (197us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783138087.353195:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783138087.353223:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922176:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783138087.353238:0:24244:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783138087.353258:0:24244:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783138087.353264:0:24244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138087.353273:0:24244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138087.353297:0:24244:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e3f043b6000 10000000:01000000:3.0:1783138087.353301:0:24244:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783138087.353306:0:24244:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783138087.353349:0:24244:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783138087.353355:0:24244:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783138087.353358:0:24244:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783138087.353380:0:24244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f00030c00/0x50a9699713c4cdc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138087.353389:0:24244:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f00030c00/0x50a9699713c4cdc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138087.353398:0:24244:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f00030c00/0x50a9699713c4cdc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138087.353423:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783138087.353453:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138087.353481:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e03b37600 going to sleep for 11 seconds 00000100:00100000:1.0:1783138087.353787:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175922304 00000100:00100000:1.0:1783138087.353792:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175922304 00000100:00100000:1.0:1783138087.353867:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783138087.353875:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f03ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+18:24244:x1869755175922304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138087.353885:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138087.353897:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f341ffc00/0x50a9699713c4cdcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cdc8 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138087.353917:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f341ffc00/0x50a9699713c4cdcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cdc8 expref: 19 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138087.353926:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f341ffc00/0x50a9699713c4cdcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cdc8 expref: 19 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138087.353945:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f341ffc00, rc 0) 00000100:00100000:1.0:1783138087.353987:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f03ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+19:24244:x1869755175922304:12345-0@lo:101:mount.lustre.0 Request processed in 113us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138087.353992:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783138087.354053:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138087.354068:0:24244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f00030c00/0x50a9699713c4cdc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdcf expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138087.354076:0:24244:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f00030c00/0x50a9699713c4cdc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cdcf expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783138087.357468:0:24244:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1783138087.358120:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783138087.362248:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1783138087.362361:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1783138087.362379:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1783138087.362394:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1783138087.362408:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1783138087.362421:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1783138087.362433:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1783138087.362468:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1783138087.362487:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1783138087.362499:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1783138087.362510:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1783138087.362521:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1783138087.362543:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1783138087.362548:0:24244:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1783138087.362653:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138087.362729:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138087.365741:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0b347900 going to sleep for 11 seconds 00000100:00100000:0.0:1783138087.367077:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175922432 00000100:00100000:0.0:1783138087.367090:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175922432 00000100:00100000:0.0:1783138087.367147:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783138087.367159:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+19:24244:x1869755175922432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138087.367790:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+19:24244:x1869755175922432:12345-0@lo:501:mount.lustre.0 Request processed in 631us (5058us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.367800:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783138087.367886:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138087.367950:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138087.367998:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138087.368036:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0b347900 going to sleep for 11 seconds 00000100:00100000:0.0:1783138087.368086:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175922560 00000100:00100000:0.0:1783138087.368090:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175922560 00000100:00100000:0.0:1783138087.368112:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783138087.368117:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+19:24244:x1869755175922560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138087.369124:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+19:24244:x1869755175922560:12345-0@lo:503:mount.lustre.0 Request processed in 1000us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.369136:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783138087.369417:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922560:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783138087.369855:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783138087.369927:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138087.369982:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138087.370026:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0b347540 going to sleep for 11 seconds 00000100:00100000:1.0:1783138087.370100:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175922688 00000100:00100000:1.0:1783138087.370106:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175922688 00000100:00100000:1.0:1783138087.370192:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783138087.370212:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+19:24244:x1869755175922688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138087.370871:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+19:24244:x1869755175922688:12345-0@lo:502:mount.lustre.0 Request processed in 668us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138087.370879:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783138087.370969:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783138087.371138:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1783138087.371165:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1783138087.371181:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1783138087.371194:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1783138087.371222:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1783138087.371235:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1783138087.371247:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1783138087.371260:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1783138087.371359:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1783138087.371380:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1783138087.371392:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1783138087.371405:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1783138087.371435:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138087.371477:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138087.371888:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0b347540 going to sleep for 11 seconds 00000100:00100000:0.0:1783138087.371927:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175922816 00000100:00100000:0.0:1783138087.371934:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175922816 00000100:00100000:0.0:1783138087.371971:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783138087.371980:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+19:24244:x1869755175922816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138087.372102:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+19:24244:x1869755175922816:12345-0@lo:502:mount.lustre.0 Request processed in 123us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.372109:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783138087.372207:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783138087.372262:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1783138087.372293:0:24244:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1783138087.373130:0:24261:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783138087.373139:0:24261:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1783138087.373145:0:24261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138087.373148:0:24261:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783138087.373154:0:24261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783138087.373168:0:24261:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e3f36248000) 00000020:00000080:2.0:1783138087.373188:0:24261:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783138087.373193:0:24261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783138087.373289:0:24261:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e3f043b6000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783138087.373298:0:24261:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783138087.373304:0:24261:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x50a9699713c4cddd 00010000:00010000:2.0:1783138087.377688:0:24261:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1783138087.378095:0:24261:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1783138087.379825:0:24261:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1783138087.382954:0:24261:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783138087.382968:0:24261:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138087.382974:0:24261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138087.382976:0:24261:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783138087.382980:0:24261:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783138087.382983:0:24261:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1783138087.382984:0:24261:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783138087.382986:0:24261:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783138087.382987:0:24261:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783138087.382990:0:24261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138087.382991:0:24261:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783138087.382993:0:24261:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138087.382996:0:24261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138087.382998:0:24261:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783138087.383000:0:24261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783138087.383003:0:24261:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783138087.383005:0:24261:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138087.383007:0:24261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138087.383008:0:24261:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783138087.383011:0:24261:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783138087.383013:0:24261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138087.383014:0:24261:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783138087.383017:0:24261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783138087.383047:0:24261:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783138087.383049:0:24261:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783138087.383051:0:24261:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783138087.383053:0:24261:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1783138087.396851:0:24244:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1783138087.396901:0:24244:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783138087.396927:0:24244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f00030c00/0x50a9699713c4cdc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdcf expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138087.396941:0:24244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f00030c00/0x50a9699713c4cdc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdcf expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138087.396951:0:24244:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9e3f043b6000 from 1 10000000:01000000:2.0:1783138087.396954:0:24244:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783138087.396991:0:24244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138087.397000:0:24244:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138087.397011:0:24244:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138087.397046:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138087.397105:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138087.397144:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2aed0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783138087.397396:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175922944 00000100:00100000:1.0:1783138087.397404:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175922944 00000100:00100000:1.0:1783138087.397446:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783138087.397454:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+19:24244:x1869755175922944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138087.397467:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138087.397479:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f341fe600/0x50a9699713c4cdeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cde4 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138087.397502:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f341fe600/0x50a9699713c4cdeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cde4 expref: 20 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138087.397512:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f341fe600/0x50a9699713c4cdeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cde4 expref: 20 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138087.397520:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f341fe600, rc 0) 00000100:00100000:1.0:1783138087.397561:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+20:24244:x1869755175922944:12345-0@lo:101:mount.lustre.0 Request processed in 108us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138087.397574:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783138087.397748:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175922944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138087.397763:0:24244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138087.397772:0:24244:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783138087.398920:0:24244:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1783138087.399160:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783138087.399613:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1783138087.399640:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1783138087.399656:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1783138087.399680:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1783138087.399693:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1783138087.399704:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1783138087.399714:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1783138087.399725:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1783138087.399737:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1783138087.399750:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1783138087.399762:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1783138087.399782:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1783138087.399788:0:24244:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1783138087.399852:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138087.399903:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138087.399946:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2b0bc540 going to sleep for 11 seconds 00000100:00100000:3.0:1783138087.400047:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175923072 00000100:00100000:3.0:1783138087.400053:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175923072 00000100:00100000:3.0:1783138087.400126:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783138087.400135:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+20:24244:x1869755175923072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138087.400244:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+20:24244:x1869755175923072:12345-0@lo:501:mount.lustre.0 Request processed in 110us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138087.400252:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783138087.400349:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138087.400382:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138087.400419:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138087.401102:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2b0bc540 going to sleep for 11 seconds 00000100:00100000:1.0:1783138087.401464:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175923200 00000100:00100000:1.0:1783138087.401471:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175923200 00000100:00100000:1.0:1783138087.401502:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783138087.401509:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+20:24244:x1869755175923200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138087.401641:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+20:24244:x1869755175923200:12345-0@lo:503:mount.lustre.0 Request processed in 132us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138087.401648:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783138087.401809:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923200:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783138087.402188:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783138087.402537:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923328:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138087.402582:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138087.402616:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2b0bc540 going to sleep for 11 seconds 00000100:00100000:1.0:1783138087.402664:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175923328 00000100:00100000:1.0:1783138087.402669:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175923328 00000100:00100000:1.0:1783138087.402699:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783138087.402706:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+20:24244:x1869755175923328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138087.402794:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+20:24244:x1869755175923328:12345-0@lo:502:mount.lustre.0 Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138087.402801:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783138087.402889:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138087.403080:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1783138087.403107:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1783138087.403123:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1783138087.403137:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1783138087.403163:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1783138087.403177:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1783138087.403189:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1783138087.403566:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1783138087.403589:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1783138087.403607:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1783138087.403622:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1783138087.403649:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138087.403695:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138087.403718:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2b0bc540 going to sleep for 11 seconds 00000100:00100000:2.0:1783138087.403776:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175923456 00000100:00100000:2.0:1783138087.403781:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175923456 00000100:00100000:2.0:1783138087.403824:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783138087.403832:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+20:24244:x1869755175923456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138087.403916:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+20:24244:x1869755175923456:12345-0@lo:502:mount.lustre.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138087.403923:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783138087.404061:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138087.404102:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1783138087.404111:0:24244:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1783138087.405039:0:24265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783138087.405049:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138087.405051:0:24265:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783138087.405057:0:24265:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e3f043b6000 00000020:00000080:1.0:1783138087.405059:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783138087.405066:0:24265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138087.405068:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138087.405070:0:24265:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783138087.405071:0:24265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783138087.405073:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138087.405075:0:24265:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783138087.405077:0:24265:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e3f043b6000 00000020:00000080:1.0:1783138087.405079:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783138087.405171:0:24265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138087.405175:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138087.405176:0:24265:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783138087.405179:0:24265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783138087.405182:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138087.405183:0:24265:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783138087.405187:0:24265:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e3f043b6000 00000020:00000080:1.0:1783138087.405189:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783138087.409424:0:24265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138087.409437:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138087.409440:0:24265:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783138087.409444:0:24265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783138087.409448:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138087.409449:0:24265:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783138087.409454:0:24265:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e3f043b6000 00000020:00000080:1.0:1783138087.409456:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783138087.409513:0:24265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138087.409517:0:24265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138087.409518:0:24265:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783138087.409521:0:24265:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1783138087.410374:0:24244:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783138087.410409:0:24244:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783138087.410428:0:24244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138087.410440:0:24244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138087.410503:0:24244:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783138087.410506:0:24244:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e3f043b6000 10000000:01000000:1.0:1783138087.410509:0:24244:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e3f043b6000 10000000:01000000:1.0:1783138087.410512:0:24244:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783138087.410518:0:24244:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9e3f043b6000 from 1 10000000:01000000:1.0:1783138087.410526:0:24244:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783138087.410561:0:24244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fea00/0x50a9699713c4cdf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138087.410570:0:24244:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f341fea00/0x50a9699713c4cdf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138087.410581:0:24244:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f341fea00/0x50a9699713c4cdf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138087.410605:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783138087.410665:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138087.410698:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e31f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138087.424588:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175923584 00000100:00100000:2.0:1783138087.424604:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175923584 00000100:00100000:2.0:1783138087.424657:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783138087.424666:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+20:24244:x1869755175923584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138087.424682:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138087.424698:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f3f479a00/0x50a9699713c4cdf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4cdf2 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138087.424723:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f3f479a00/0x50a9699713c4cdf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4cdf2 expref: 21 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138087.424734:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f3f479a00/0x50a9699713c4cdf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cdf2 expref: 21 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138087.424742:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f3f479a00, rc 0) 00000100:00100000:2.0:1783138087.428560:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175923584:12345-0@lo:101:mount.lustre.0 Request processed in 3883us (17883us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138087.428580:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783138087.434487:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138087.434517:0:24244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f341fea00/0x50a9699713c4cdf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdf9 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138087.434529:0:24244:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f341fea00/0x50a9699713c4cdf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4cdf9 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783138087.436554:0:24244:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1783138087.436819:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783138087.437041:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1783138087.437065:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1783138087.437078:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1783138087.437091:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1783138087.437102:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1783138087.437113:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1783138087.437125:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1783138087.437136:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1783138087.437159:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1783138087.437174:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1783138087.437187:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1783138087.439431:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1783138087.439468:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1783138087.439482:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1783138087.439495:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1783138087.439509:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1783138087.439523:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1783138087.439537:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1783138087.439549:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1783138087.439562:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1783138087.439576:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1783138087.439589:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1783138087.439601:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1783138087.439613:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1783138087.439625:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1783138087.439638:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1783138087.439650:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1783138087.439680:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1783138087.439696:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1783138087.439709:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1783138087.439722:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1783138087.439733:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1783138087.439746:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1783138087.439758:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1783138087.439771:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1783138087.439785:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1783138087.439798:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1783138087.439810:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1783138087.439823:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1783138087.439837:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1783138087.439850:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1783138087.439873:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1783138087.439887:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1783138087.439918:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1783138087.439934:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1783138087.439946:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1783138087.439959:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1783138087.439971:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1783138087.440124:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1783138087.440146:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1783138087.440164:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1783138087.440170:0:24244:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1783138087.442432:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138087.442505:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138087.442551:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0b347c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783138087.444365:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175923712 00000100:00100000:0.0:1783138087.444376:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175923712 00000100:00100000:0.0:1783138087.444435:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783138087.444445:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175923712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138087.444616:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175923712:12345-0@lo:501:mount.lustre.0 Request processed in 172us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.444625:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783138087.445506:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138087.445557:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138087.445612:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138087.445644:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175923840 00000100:00100000:1.0:1783138087.445649:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175923840 00000100:00100000:1.0:1783138087.445683:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783138087.445691:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175923840:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138087.445778:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175923840:12345-0@lo:503:mount.lustre.0 Request processed in 87us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138087.445785:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783138087.445829:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0b347c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138087.445843:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923840:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783138087.446832:0:24244:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783138087.446915:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138087.446968:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138087.447000:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2af826c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138087.447305:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175923968 00000100:00100000:2.0:1783138087.447335:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175923968 00000100:00100000:2.0:1783138087.447378:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783138087.447386:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175923968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138087.447486:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175923968:12345-0@lo:502:mount.lustre.0 Request processed in 100us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138087.447493:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783138087.448160:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175923968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138087.448404:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1783138087.448434:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1783138087.448449:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1783138087.448463:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1783138087.448494:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1783138087.448511:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1783138087.448527:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1783138087.448543:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1783138087.448558:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1783138087.448574:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1783138087.448588:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1783138087.448601:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1783138087.448615:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1783138087.448628:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1783138087.448643:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1783138087.448656:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1783138087.448668:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1783138087.448679:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1783138087.448690:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1783138087.448701:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1783138087.448725:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1783138087.448739:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1783138087.448750:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1783138087.448762:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1783138087.448774:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1783138087.448787:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1783138087.448803:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1783138087.448827:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1783138087.448842:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1783138087.448855:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1783138087.448868:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1783138087.448880:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1783138087.448892:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1783138087.448906:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1783138087.448920:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1783138087.448934:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1783138087.448961:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1783138087.448977:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1783138087.448989:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1783138087.449002:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1783138087.449016:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1783138087.449029:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1783138087.449041:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1783138087.449052:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1783138087.449064:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1783138087.449074:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1783138087.449086:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1783138087.449097:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1783138087.449140:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175924096:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138087.449200:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138087.449247:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175924096 00000100:00100000:1.0:1783138087.449253:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175924096 00000100:00100000:1.0:1783138087.449291:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783138087.449298:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175924096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138087.449670:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175924096:12345-0@lo:502:mount.lustre.0 Request processed in 371us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138087.449678:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783138087.449733:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e31f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138087.449751:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175924096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783138087.449893:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1783138087.449916:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1783138087.449940:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175924224:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138087.449973:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138087.449998:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e31f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138087.450299:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175924224 00000100:00100000:0.0:1783138087.450304:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175924224 00000100:00100000:0.0:1783138087.450813:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783138087.450822:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175924224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138087.450931:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175924224:12345-0@lo:502:mount.lustre.0 Request processed in 109us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.450938:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783138087.451483:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175924224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783138087.451546:0:24244:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1783138087.451559:0:24244:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783138087.452387:0:24271:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783138087.452405:0:24271:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e3f2a83b380) 00000020:00000080:1.0:1783138087.452429:0:24271:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1783138087.452602:0:24271:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e3f043b6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783138087.452606:0:24271:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e3f043b6000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783138087.452609:0:24271:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3f043b6000 3 00010000:00080000:1.0:1783138087.452636:0:24271:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3f340c0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1783138087.460584:0:24271:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1783138087.460688:0:24271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783138087.460733:0:24271:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783138087.460759:0:24271:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x50a9699713c4ce07 00000100:00080000:1.0:1783138087.460770:0:24271:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783138087.460776:0:24271:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e3f340c0000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1783138087.460807:0:24271:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2f882300 x1869755175924352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783138087.460838:0:24271:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783138087.461050:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869755175924352:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783138087.461117:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783138087.461434:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.461445:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138087.461448:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.461451:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138087.461454:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.461457:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138087.461459:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.461462:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:3.0:1783138087.461708:0:24271:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783138087.461723:0:24271:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9e3f1f9f19c0) 00000020:00000080:3.0:1783138087.461742:0:24271:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1783138087.461883:0:24271:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e3f043b6000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783138087.461888:0:24271:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e3f043b6000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783138087.461897:0:24271:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3f043b6000 3 00010000:00080000:3.0:1783138087.461927:0:24271:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3f2f87f800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.143@tcp at head 00000100:00100000:1.0:1783138087.462390:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175924352 00000100:00100000:1.0:1783138087.462399:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175924352 00000100:00100000:1.0:1783138087.462435:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783138087.462442:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1869755175924352:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783138087.462466:0:22742:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 749 last 0 00000020:00000080:1.0:1783138087.462525:0:22742:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x50a9699713c4ce15 00000004:00100000:1.0:1783138087.462541:0:22742:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783138087.462572:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9e3e038dc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783138087.462646:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1869755175924352:12345-0@lo:38:llog_process_th.0 Request processed in 203us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138087.462654:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783138087.462706:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e3f2f882300 x1869755175924352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138087.462717:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783138087.462725:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1783138087.462732:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783138087.462736:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783138087.462738:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783138087.462744:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1869755175924352:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1783138087.467928:0:24271:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1783138087.468037:0:24271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1783138087.468082:0:24271:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783138087.468095:0:24271:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x50a9699713c4ce1c 00000100:00080000:3.0:1783138087.468104:0:24271:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783138087.468110:0:24271:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9e3f2f87f800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1783138087.468144:0:24271:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2a985880 x1869755175924480/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138087.468187:0:24271:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783138087.470247:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1869755175924480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783138087.470350:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138087.470417:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175924480 00000100:00100000:2.0:1783138087.470426:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175924480 00000100:00100000:2.0:1783138087.470464:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138087.470472:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1869755175924480:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783138087.470501:0:23996:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 749 last 0 00000020:00000080:2.0:1783138087.470552:0:23996:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x50a9699713c4ce23 00000004:00100000:2.0:1783138087.470565:0:23996:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783138087.470593:0:23996:0:(import.c:65:import_set_state_nolock()) ffff9e3e0426e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138087.470640:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1869755175924480:12345-0@lo:38:llog_process_th.0 Request processed in 167us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138087.470647:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783138087.470685:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e3f2a985880 x1869755175924480/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138087.470702:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783138087.470709:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1783138087.470717:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783138087.470721:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783138087.470723:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f2f87f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783138087.470729:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1869755175924480:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1783138087.473309:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.473348:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138087.473351:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.473355:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138087.473358:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.473361:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138087.473364:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138087.473367:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1783138087.475437:0:24271:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1783138087.476153:0:24244:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783138087.476189:0:24244:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783138087.476306:0:24244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fea00/0x50a9699713c4cdf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdf9 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138087.476347:0:24244:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341fea00/0x50a9699713c4cdf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cdf9 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783138087.476400:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783138087.476403:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783138087.476405:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138087.476406:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138087.476407:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138087.476409:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138087.476410:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138087.476412:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138087.476413:0:24244:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783138087.476417:0:24244:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783138087.476420:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783138087.476421:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783138087.476422:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138087.476423:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138087.476425:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138087.476426:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138087.476427:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138087.476433:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138087.476434:0:24244:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783138087.476459:0:24244:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783138087.476480:0:24244:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175924608:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783138087.476553:0:24244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138087.476600:0:24244:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2aed0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783138087.476950:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175924608 00000100:00100000:3.0:1783138087.476957:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175924608 00000100:00100000:3.0:1783138087.477011:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783138087.477021:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+21:24244:x1869755175924608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783138087.477048:0:22735:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783138087.477062:0:22735:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783138087.482059:0:22735:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783138087.482080:0:22735:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783138087.482256:0:22758:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783138087.482261:0:22758:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783138087.482284:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.482303:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3e028fea00/0x50a9699713c4cd74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cd6d expref: 21 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.482354:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3e028ff600/0x50a9699713c4cd82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cd7b expref: 21 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.482362:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.482401:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3e028ff600/0x50a9699713c4cd82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4cd7b expref: 21 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.482414:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3e028ff600/0x50a9699713c4cd82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4cd7b expref: 21 pid: 22736 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138087.482430:0:22758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175924736:0@lo:104: 00000100:00100000:0.0:1783138087.482501:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783138087.482548:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3e028fea00/0x50a9699713c4cd74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4cd6d expref: 21 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.482556:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3e028fea00/0x50a9699713c4cd74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4cd6d expref: 21 pid: 22736 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138087.482565:0:22758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04332a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175924864:0@lo:104: 00000100:00100000:0.0:1783138087.482590:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138087.482610:0:22758:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e17e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138087.483238:0:22726:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783138087.483259:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175924736 00000100:00100000:3.0:1783138087.483267:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175924736 00000100:00100000:3.0:1783138087.483303:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175924864 00000100:00100000:3.0:1783138087.483306:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175924864 00000100:00100000:3.0:1783138087.483346:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138087.483356:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff132a53-abfa-4987-a345-1706880f10ac+4:22758:x1869755175924736:12345-0@lo:104: 00010000:00010000:3.0:1783138087.483369:0:22726:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138087.483438:0:22726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783138087.483444:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff132a53-abfa-4987-a345-1706880f10ac+4:22758:x1869755175924736:12345-0@lo:104: Request processed in 90us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138087.483451:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138087.483467:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783138087.483473:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2cbe4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff132a53-abfa-4987-a345-1706880f10ac+3:22758:x1869755175924864:12345-0@lo:104: 00010000:00010000:3.0:1783138087.483481:0:22726:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138087.483508:0:22726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783138087.483513:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2cbe4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff132a53-abfa-4987-a345-1706880f10ac+3:22758:x1869755175924864:12345-0@lo:104: Request processed in 41us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138087.483518:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1783138087.483660:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138087.483667:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.483675:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f00030a00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:0.0:1783138087.483678:0:22730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.483693:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138087.483700:0:22730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138087.483706:0:22730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783138087.483736:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.483743:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783138087.483761:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.483768:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f00030a00/0x50a9699713c4cd7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd82 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.483783:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138087.483786:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.483791:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f00031600 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:0.0:1783138087.483794:0:22730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.483800:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138087.483805:0:22730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138087.483816:0:22730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783138087.483830:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.483836:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783138087.483850:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.483869:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f00031600/0x50a9699713c4cd6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd74 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.483883:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138087.483885:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138087.483886:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138087.483893:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138087.483909:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175924992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138087.483940:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138087.483998:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175925120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138087.484024:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138087.484057:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175924992 00000100:00100000:0.0:1783138087.484060:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175924992 00010000:00010000:0.0:1783138087.484077:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3e028ff600/0x50a9699713c4cd82 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cd7b expref: 22 pid: 22736 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138087.484095:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175925120 00000100:00100000:0.0:1783138087.484098:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175925120 00010000:00010000:0.0:1783138087.484108:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3e028fea00/0x50a9699713c4cd74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cd6d expref: 23 pid: 22736 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138087.484133:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783138087.484139:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+23:3659:x1869755175924992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138087.484149:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138087.484155:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3e028ff600/0x50a9699713c4cd82 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cd7b expref: 23 pid: 22736 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484164:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3e028ff600/0x50a9699713c4cd82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4cd7b expref: 23 pid: 22736 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484179:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138087.484272:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+23:3659:x1869755175924992:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.484280:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783138087.484296:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138087.484302:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2c2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+22:3660:x1869755175925120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138087.484309:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138087.484350:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3e028fea00/0x50a9699713c4cd74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cd6d expref: 22 pid: 22736 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484358:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3e028fea00/0x50a9699713c4cd74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4cd6d expref: 22 pid: 22736 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484369:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484378:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783138087.484402:0:22728:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004365398s 00010000:00010000:0.0:1783138087.484406:0:22728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484412:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484419:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484425:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484431:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028fee00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138087.484435:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484442:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484451:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484459:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138087.484487:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2c2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+22:3660:x1869755175925120:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.484493:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138087.484556:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175925120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138087.484582:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175924992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138087.484614:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028ff600/0x50a9699713c4cd82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4cd7b expref: 21 pid: 22736 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138087.484624:0:22758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175924736:0@lo:104: 00010000:00010000:0.0:1783138087.484634:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028fea00/0x50a9699713c4cd74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4cd6d expref: 20 pid: 22736 timeout: 849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138087.484642:0:22758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04332a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175924864:0@lo:104: 00010000:00010000:0.0:1783138087.484654:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484664:0:22758:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484670:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138087.484676:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028fee00/0x50a9699713c4ce2a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138087.484733:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+19:24244:x1869755175924608:12345-0@lo:253:mount.lustre.0 Request processed in 7714us (8179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138087.484741:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783138087.484779:0:24244:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:24244:1869755175924608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783138087.484789:0:24244:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783138087.484793:0:24244:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783138087.484794:0:24244:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783138087.484795:0:24244:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783138087.484797:0:24244:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783138087.484803:0:24244:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783138087.484804:0:24244:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783138087.484806:0:24244:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783138087.484808:0:24244:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783138087.484809:0:24244:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783138087.484819:0:24244:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1783138087.488716:0:24244:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1783138087.496692:0:24244:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783138087.496703:0:24244:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783138087.496742:0:24244:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783138087.496796:0:24244:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783138087.496821:0:24244:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783138087.496849:0:24244:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1783138087.497761:0:24244:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783138087.497987:0:24244:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783138087.748060:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783138088.308145:0:24324:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783138088.308475:0:24324:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783138088.761929:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783138089.082918:0:22776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1783138089.401384:0:22739:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783138089.401393:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9e3e038cb000 from 13 10000000:01000000:0.0:1783138089.401399:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783138089.401444:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138089.401456:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138089.401467:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138089.401495:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04332a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175925248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783138089.401561:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138089.401613:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f02bcd000 going to sleep for 11 seconds 00000100:00100000:1.0:1783138089.401813:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175925248 00000100:00100000:1.0:1783138089.401821:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175925248 00000100:00100000:1.0:1783138089.401882:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783138089.401893:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+19:22739:x1869755175925248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138089.401907:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138089.401923:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f341fe800/0x50a9699713c4ce38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4ce31 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138089.401948:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f341fe800/0x50a9699713c4ce38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4ce31 expref: 20 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138089.401961:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f341fe800/0x50a9699713c4ce38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4ce31 expref: 20 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138089.401983:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f341fe800, rc 0) 00000100:00100000:1.0:1783138089.402034:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+20:22739:x1869755175925248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138089.402041:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783138089.402100:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04332a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175925248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138089.402118:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138089.402129:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138089.402191:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175925376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783138089.402224:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138089.402241:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e31f600 going to sleep for 11 seconds 00000100:00100000:3.0:1783138089.403397:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175925376 00000100:00100000:3.0:1783138089.403406:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175925376 00000100:00100000:3.0:1783138089.403460:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783138089.403469:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+20:22739:x1869755175925376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783138089.403491:0:22737:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783138089.403508:0:22737:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783138089.403515:0:22737:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1783138089.403627:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+20:22739:x1869755175925376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138089.403635:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783138089.403767:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175925376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783138089.403842:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783138089.403851:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138089.403861:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138089.403872:0:22739:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783138089.403875:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9e3f3625b800 from 13 10000000:01000000:1.0:1783138089.403878:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783138089.403907:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138089.403920:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138089.403929:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138089.403949:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175925504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783138089.403982:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138089.404012:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e31f600 going to sleep for 11 seconds 00000100:00100000:3.0:1783138089.404196:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175925504 00000100:00100000:3.0:1783138089.404201:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175925504 00000100:00100000:3.0:1783138089.404231:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783138089.404238:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+20:22739:x1869755175925504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138089.404248:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138089.404262:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f00031400/0x50a9699713c4ce46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4ce3f expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138089.404284:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f00031400/0x50a9699713c4ce46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4ce3f expref: 21 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138089.404294:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f00031400/0x50a9699713c4ce46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4ce3f expref: 21 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138089.404327:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f00031400, rc 0) 00000100:00100000:3.0:1783138089.404363:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:22739:x1869755175925504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138089.404368:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783138089.404405:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175925504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138089.404417:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138089.404426:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138089.404481:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a984a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175925632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783138089.404518:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138089.404531:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0ad75e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783138089.404542:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175925632 00000100:00100000:3.0:1783138089.404545:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175925632 00000100:00100000:3.0:1783138089.404567:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783138089.404573:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:22739:x1869755175925632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783138089.404583:0:22736:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783138089.404595:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783138089.404598:0:22736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1783138089.404661:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:22739:x1869755175925632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 87us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138089.404668:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783138089.404696:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a984a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175925632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783138089.404735:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783138089.404742:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138089.404750:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138089.785746:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138090.809686:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138091.834398:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138092.409523:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175925760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138092.409622:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138092.409703:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175925760 00000100:00100000:1.0:1783138092.409712:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175925760 00000100:00100000:1.0:1783138092.415900:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783138092.415931:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175925760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783138092.415995:0:22748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783138092.416124:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175925760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 206us (6502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138092.416133:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783138092.416478:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175925760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138092.417855:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175925888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783138092.417942:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138092.418382:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175925888 00000100:00100000:2.0:1783138092.418395:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175925888 00000100:00100000:2.0:1783138092.418451:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783138092.418462:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175925888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783138092.418518:0:23767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783138092.418781:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175925888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 319us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138092.418790:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783138092.418980:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175925888:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783138092.857589:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783138092.922089:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138092.922095:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138092.922098:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138092.922101:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138092.922128:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138092.922132:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138092.922134:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138092.922137:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783138092.922175:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175926016:0@lo:400:kworker.0 00000100:00100000:3.0:1783138092.922265:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138092.922332:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869755175926528:0@lo:400:kworker.0 00000100:00100000:3.0:1783138092.922364:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138092.922386:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783138092.922389:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175926528 00000100:00100000:3.0:1783138092.922392:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1869755175926400:0@lo:400:kworker.0 00000100:00100000:1.0:1783138092.922397:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175926528 00000100:00100000:3.0:1783138092.922411:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138092.922436:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175926144:0@lo:400:kworker.0 00000100:00100000:1.0:1783138092.922447:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175926400 00000100:00100000:1.0:1783138092.922450:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175926400 00000100:00100000:3.0:1783138092.922457:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138092.922467:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175926144 00000100:00100000:1.0:1783138092.922469:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175926144 00000100:00100000:3.0:1783138092.922472:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783138092.922477:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175926272:0@lo:400:kworker.0 00000100:00100000:1.0:1783138092.922483:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783138092.922491:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869755175926528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138092.922496:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138092.922517:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175926016 00000100:00100000:3.0:1783138092.922520:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175926016 00000100:00100000:3.0:1783138092.922548:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783138092.922555:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:3659:x1869755175926016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138092.922560:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869755175926528:12345-0@lo:400:kworker.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138092.922567:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783138092.922580:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:3659:x1869755175926016:12345-0@lo:400:kworker.0 Request processed in 26us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138092.922582:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175926272 00000100:00100000:1.0:1783138092.922584:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175926272 00000100:00100000:3.0:1783138092.922586:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783138092.922596:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783138092.922601:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1869755175926400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138092.922624:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783138092.922627:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1869755175926400:12345-0@lo:400:kworker.0 Request processed in 26us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138092.922633:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783138092.922636:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175926144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138092.922643:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783138092.922648:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175926272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138092.922667:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175926144:12345-0@lo:400:kworker.0 Request processed in 32us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138092.922673:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783138092.922710:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f2a986d80 x1869755175926144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138092.922724:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175926144:0@lo:400:kworker.0 00010000:00080000:3.0:1783138092.922749:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f2a984380 x1869755175926400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138092.922757:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1869755175926400:0@lo:400:kworker.0 00000100:00100000:3.0:1783138092.922764:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175926016:0@lo:400:kworker.0 00010000:00080000:3.0:1783138092.922772:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f2a987800 x1869755175926528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138092.922780:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869755175926528:0@lo:400:kworker.0 00000100:00100000:1.0:1783138092.923349:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175926272:12345-0@lo:400:kworker.0 Request processed in 698us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138092.923357:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1783138092.923387:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783138092.923391:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783138092.923779:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f2a987480 x1869755175926272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138092.923792:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175926272:0@lo:400:kworker.0 00000040:00080000:2.0:1783138093.440826:0:23496:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783138093.884211:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783138094.000675:0:24615:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783138094.911206:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783138094.998882:0:24667:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783138094.999138:0:24667:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1783138095.872719:0:24717:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783138095.873082:0:24717:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783138095.933680:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138096.701449:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138081/real 1783138081] req@ffff9e3e03b02d80 x1869755175919488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138096 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138096.701476:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3e03b02d80 x1869755175919488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138096 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138096.701486:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138081/real 1783138081] req@ffff9e3e03b03480 x1869755175919616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138096 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138096.701507:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3e03b03480 x1869755175919616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138096 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783138096.701524:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f0af9d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138096.702143:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783138096.702149:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175919488:0@lo:8:kworker.0 00000100:00080000:3.0:1783138096.702156:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783138096.702812:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175926656:0@lo:400:kworker.0 00000100:00100000:2.0:1783138096.702879:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783138096.702994:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783138096.702999:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175919616:0@lo:8:kworker.0 00000100:00100000:1.0:1783138096.703382:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175926656 00000100:00100000:1.0:1783138096.703390:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175926656 00000100:00100000:1.0:1783138096.703434:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783138096.703442:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+21:3660:x1869755175926656:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783138096.703760:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138096.703765:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138096.703767:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138096.703770:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138096.703823:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138096.703826:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783138096.703829:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3f0af9d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138096.703834:0:16974:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 742 00000100:00080000:0.0:1783138096.703838:0:16974:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783138096.703843:0:16974:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e3f0af9d000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138096.703861:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e04332d80 x1869755175927168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138096.703877:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138096.703880:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783138096.703881:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783138096.703885:0:16974:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 742 00000100:00080000:0.0:1783138096.703888:0:16974:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783138096.703891:0:16974:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e3f340c6000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138096.703902:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e04331c00 x1869755175927296/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138096.703944:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138096.703947:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783138096.703949:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783138096.703951:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783138096.703966:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175926784:0@lo:400:kworker.0 00000100:00100000:0.0:1783138096.704001:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138096.704025:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869755175927552:0@lo:400:kworker.0 00000100:00100000:0.0:1783138096.704064:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138096.704209:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175926912:0@lo:400:kworker.0 00000100:00100000:3.0:1783138096.704239:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138096.704267:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869755175927680:0@lo:400:kworker.0 00000100:00100000:3.0:1783138096.704288:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138096.704308:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783138096.704333:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175927040:0@lo:400:kworker.0 00000100:00100000:3.0:1783138096.704354:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138096.704383:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175927552 00000100:00100000:3.0:1783138096.704387:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175927552 00000100:00100000:3.0:1783138096.704421:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175926912 00000100:00100000:3.0:1783138096.704423:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175926912 00000100:00100000:3.0:1783138096.704433:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175927680 00000100:00100000:3.0:1783138096.704436:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175927680 00000100:00100000:3.0:1783138096.704448:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783138096.704454:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869755175927552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138096.704491:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1869755175927552:12345-0@lo:400:kworker.0 Request processed in 36us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138096.704505:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783138096.704521:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783138096.704527:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175926912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138096.704559:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1869755175926912:12345-0@lo:400:kworker.0 Request processed in 32us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138096.704565:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783138096.704576:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783138096.704583:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869755175927680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138096.704608:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869755175927680:12345-0@lo:400:kworker.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138096.704614:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783138096.704631:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175926784 00000100:00100000:3.0:1783138096.704633:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175926784 00000100:00100000:3.0:1783138096.704653:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175927040 00000100:00100000:3.0:1783138096.704655:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175927040 00000100:00100000:3.0:1783138096.704666:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783138096.704671:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175926784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138096.704701:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175926784:12345-0@lo:400:kworker.0 Request processed in 30us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138096.704707:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783138096.704717:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783138096.704722:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175927040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138096.704764:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175927040:12345-0@lo:400:kworker.0 Request processed in 41us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138096.704770:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783138096.704812:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175927040:0@lo:400:kworker.0 00010000:00080000:3.0:1783138096.704825:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3e04333800 x1869755175926912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138096.704834:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1869755175926912:0@lo:400:kworker.0 00010000:00080000:3.0:1783138096.704844:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3e04332680 x1869755175927680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138096.704851:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869755175927680:0@lo:400:kworker.0 00010000:00080000:0.0:1783138096.705351:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3e04332a00 x1869755175927552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138096.705361:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1869755175927552:0@lo:400:kworker.0 00000100:00100000:0.0:1783138096.705381:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175926784:0@lo:400:kworker.0 00000100:00100000:0.0:1783138096.705389:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783138096.705395:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869755175927424:0@lo:400:kworker.0 00000100:00100000:0.0:1783138096.705425:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138096.705459:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175927424 00000100:00100000:0.0:1783138096.705463:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175927424 00000100:00100000:0.0:1783138096.705486:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783138096.705492:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869755175927424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138096.705528:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869755175927424:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138096.705533:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1783138096.705560:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3e04333100 x1869755175927424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138096.705568:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869755175927424:0@lo:400:kworker.0 00000100:00100000:0.0:1783138096.705586:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175927168:0@lo:8:kworker.0 00000100:00100000:0.0:1783138096.705615:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138096.705639:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175927296:0@lo:8:kworker.0 00000100:00100000:0.0:1783138096.705662:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138096.706198:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175927168 00000100:00100000:3.0:1783138096.706205:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175927168 00000100:00100000:3.0:1783138096.706225:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175927296 00000100:00100000:3.0:1783138096.706228:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175927296 00000100:00100000:3.0:1783138096.706239:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783138096.706254:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1869755175927168:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783138096.706280:0:24248:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 758 last 0 00000020:00000080:3.0:1783138096.706305:0:24248:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50a9699713c4ce4d 00002000:00100000:3.0:1783138096.706335:0:24248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9e3f2f87e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113655 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1783138096.706339:0:24248:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1783138096.706343:0:24248:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783138096.706515:0:24248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1783138096.706539:0:24248:0:(import.c:65:import_set_state_nolock()) ffff9e3f2f878000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783138096.706590:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1869755175927168:12345-0@lo:8:kworker.0 Request processed in 346us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138096.706597:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783138096.706612:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783138096.706616:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1869755175927296:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783138096.706642:0:24248:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783138096.708353:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+21:3660:x1869755175926656:12345-0@lo:400:kworker.0 Request processed in 4903us (5465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138096.708367:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1783138096.708439:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783138096.708445:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783138096.708600:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3e04332d80 x1869755175927168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783138116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138096.708612:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783138096.708622:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1783138096.708630:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783138096.708635:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783138096.708638:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f0af9d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783138096.708661:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783138096.708668:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175927168:0@lo:8:kworker.0 00000004:00080000:0.0:1783138096.710385:0:23485:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783138096.710413:0:23485:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23485:1869755175927936:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1783138096.710484:0:23485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138096.710511:0:23485:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f098606c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138096.710530:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175927808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138096.710553:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783138096.710614:0:23484:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783138096.710703:0:23484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 758444390120ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783138096.710710:0:23484:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1783138096.710743:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783138096.710751:0:24249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1783138096.711258:0:24250:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783138096.711273:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175927936 00000100:00100000:1.0:1783138096.711280:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175927936 00000100:00080000:1.0:1783138096.711457:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783138096.711582:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175926656:0@lo:400:kworker.0 00000100:00100000:2.0:1783138096.712382:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138096.712394:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23485:x1869755175927936:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1783138096.714554:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175927808 00000100:00100000:0.0:1783138096.714564:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175927808 00000100:00100000:0.0:1783138096.714608:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783138096.714617:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3659:x1869755175927808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783138096.714641:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138096.714721:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3659:x1869755175927808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (4166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138096.714728:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:2.0:1783138096.716346:0:24746:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1783138096.716370:0:24746:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1783138096.716444:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23485:x1869755175927936:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4049us (5956us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138096.716454:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783138096.716500:0:23485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f0ac9f100 x1869755175927936/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783138112 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138096.716513:0:23485:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23485:1869755175927936:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1783138096.716525:0:23485:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1783138096.716561:0:23485:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23485:1869755175928064:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1783138096.716586:0:23485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138096.716604:0:23485:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a88d780 going to sleep for 11 seconds 00000100:00100000:2.0:1783138096.716617:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175928064 00000100:00100000:2.0:1783138096.716622:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175928064 00000100:00100000:2.0:1783138096.716650:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138096.716656:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23485:x1869755175928064:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1783138096.716677:0:24746:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1783138096.716698:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23485:x1869755175928064:12345-0@lo:5:osp-pre-0-1.0 Request processed in 43us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138096.716704:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783138096.716723:0:23485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f3f48d880 x1869755175928064/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783138112 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138096.716731:0:23485:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23485:1869755175928064:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1783138096.716739:0:23485:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00010000:00080000:1.0:1783138096.716864:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f0ac9e300 x1869755175927808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138096.716879:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175927808:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1783138096.722685:0:23476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1783138096.741886:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1869755175927296:12345-0@lo:8:kworker.0 Request processed in 35258us (36213us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783138096.741903:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783138096.742030:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138096.742037:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783138096.742041:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175927296:0@lo:8:kworker.0 00010000:00010000:3.0:1783138096.954110:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138097.535477:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175928192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783138097.535552:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138097.535603:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783138097.535610:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175928320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783138097.535631:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138097.535686:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175928192 00000100:00100000:1.0:1783138097.535696:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175928192 00000100:00100000:2.0:1783138097.535742:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175928320 00000100:00100000:2.0:1783138097.535748:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175928320 00000100:00100000:1.0:1783138097.535777:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783138097.535912:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175928192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783138097.535949:0:23767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783138097.536012:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175928192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 225us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138097.536085:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175928192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138097.537196:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783138097.537224:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175928320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783138097.537266:0:22748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783138097.537503:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175928320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 284us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138097.537513:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783138097.541228:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783138097.542363:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175928320:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783138097.979214:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138099.003263:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783138099.327074:0:22776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783138100.025590:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138101.049756:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138102.078561:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138102.137496:0:23485:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f880e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23485:1869755175928576:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1783138102.137571:0:23485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138102.137623:0:23485:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f02bcd300 going to sleep for 11 seconds 00000100:00100000:3.0:1783138102.137893:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783138102.137909:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175928448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783138102.137942:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.138455:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175928448 00000100:00100000:0.0:1783138102.138463:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175928448 00000100:00100000:0.0:1783138102.138527:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783138102.138537:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869755175928448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783138102.138564:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138102.138628:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3659:x1869755175928448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138102.138635:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783138102.138676:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f2f883100 x1869755175928448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138102.138692:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175928448:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783138102.139094:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138102.139098:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783138102.139101:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138102.139103:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783138102.139115:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783138102.139118:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783138102.139121:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783138102.139126:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 758 00000100:00080000:1.0:1783138102.139130:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783138102.139134:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e3f340c6000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1783138102.139151:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2f881500 x1869755175929216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783138102.139536:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783138102.140771:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175929088:0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.140836:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.140894:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783138102.140901:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175928704:0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.140931:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.140956:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869755175929344:0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.140980:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.141007:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175928832:0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.141029:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.141045:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175929472:0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.141065:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.141082:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783138102.141087:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175928960:0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.141129:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.141146:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869755175929600:0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.141170:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.141220:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175929216:0@lo:8:kworker.0 00000100:00100000:0.0:1783138102.141248:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138102.141272:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175928704 00000100:00100000:1.0:1783138102.141281:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175928704 00000100:00100000:0.0:1783138102.141285:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175929344 00000100:00100000:0.0:1783138102.141290:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175929344 00000100:00100000:0.0:1783138102.141341:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175929472 00000100:00100000:0.0:1783138102.141345:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175929472 00000100:00100000:1.0:1783138102.141357:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783138102.141375:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175928960 00000100:00100000:1.0:1783138102.141377:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+21:3658:x1869755175928704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.141379:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175928960 00000100:00100000:0.0:1783138102.141395:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175929600 00000100:00100000:0.0:1783138102.141399:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175929600 00000100:00100000:0.0:1783138102.141421:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783138102.141429:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869755175929344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138102.141441:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+21:3658:x1869755175928704:12345-0@lo:400:kworker.0 Request processed in 67us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.141450:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783138102.141471:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869755175929344:12345-0@lo:400:kworker.0 Request processed in 42us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138102.141479:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783138102.141495:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783138102.141501:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175929472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.141532:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175929472:12345-0@lo:400:kworker.0 Request processed in 31us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138102.141538:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783138102.141548:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783138102.141553:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175928960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.141576:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175928960:12345-0@lo:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138102.141592:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783138102.141603:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783138102.141608:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869755175929600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138102.141771:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175929088 00000100:00100000:3.0:1783138102.141775:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175929088 00000100:00100000:3.0:1783138102.141802:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175928832 00000100:00100000:3.0:1783138102.141805:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175928832 00000100:00100000:3.0:1783138102.141817:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783138102.141823:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175929088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138102.141858:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175929088:12345-0@lo:400:kworker.0 Request processed in 34us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.141863:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783138102.141875:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783138102.141880:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175928832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138102.141910:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175928832:12345-0@lo:400:kworker.0 Request processed in 30us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.141924:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000001:00100000:1.0:1783138102.141946:0:24245:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1783138102.142797:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869755175929600:12345-0@lo:400:kworker.0 Request processed in 1187us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138102.142805:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783138102.142846:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175928576 00000100:00100000:0.0:1783138102.142851:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175928576 00000100:00100000:0.0:1783138102.142875:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175929216 00000100:00100000:0.0:1783138102.142878:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175929216 00000100:00100000:0.0:1783138102.142959:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783138102.142967:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23485:x1869755175928576:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1783138102.143003:0:24250:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:0.0:1783138102.143176:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175928704:0@lo:400:kworker.0 00010000:00080000:0.0:1783138102.143194:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f2f883100 x1869755175929344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138102.143217:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869755175929344:0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.143232:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175929088:0@lo:400:kworker.0 00010000:00080000:0.0:1783138102.143274:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f2f882680 x1869755175928960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138102.143284:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175928960:0@lo:400:kworker.0 00010000:00080000:0.0:1783138102.143295:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f362d8a80 x1869755175929600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138102.143331:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869755175929600:0@lo:400:kworker.0 00000100:00100000:0.0:1783138102.143346:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175928832:0@lo:400:kworker.0 00010000:00080000:0.0:1783138102.143356:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f362daa00 x1869755175929472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138102.143364:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175929472:0@lo:400:kworker.0 00000100:00080000:0.0:1783138102.143385:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783138102.143389:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783138102.148765:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138102.148778:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1869755175929216:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783138102.148803:0:24248:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783138102.148930:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1869755175929216:12345-0@lo:8:kworker.0 Request processed in 152us (7679us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783138102.148939:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1783138102.148990:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783138102.148995:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783138102.148999:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175929216:0@lo:8:kworker.0 00000100:00100000:3.0:1783138102.171819:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23485:x1869755175928576:12345-0@lo:5:osp-pre-0-1.0 Request processed in 28846us (34241us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1783138102.171832:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783138102.172008:0:23485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f2f880e00 x1869755175928576/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783138118 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138102.172025:0:23485:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f880e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23485:1869755175928576:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1783138102.172040:0:23485:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1783138102.172082:0:23485:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23485:1869755175929728:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1783138102.172132:0:23485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138102.172154:0:23485:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0ad75600 going to sleep for 11 seconds 00000100:00100000:3.0:1783138102.174221:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175929728 00000100:00100000:3.0:1783138102.174235:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175929728 00000100:00100000:3.0:1783138102.174298:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783138102.174308:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23485:x1869755175929728:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1783138102.174421:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23485:x1869755175929728:12345-0@lo:900:osp-pre-0-1.0 Request processed in 114us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.174428:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783138102.174577:0:23485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f3f48d180 x1869755175929728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783138118 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138102.174592:0:23485:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23485:1869755175929728:0@lo:900:osp-pre-0-1.0 00000020:01000004:2.0:1783138102.539002:0:25063:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783138102.539006:0:25063:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783138102.539008:0:25063:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783138102.540919:0:25063:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e3e040f7000 00000020:01000004:2.0:1783138102.540941:0:25063:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783138102.540958:0:25063:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783138102.540972:0:25063:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e3e03914d40) 00000020:00000080:2.0:1783138102.541009:0:25063:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783138102.582565:0:25063:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783138102.585213:0:25063:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783138102.585504:0:25063:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783138102.585697:0:25063:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783138102.586146:0:25063:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783138102.586377:0:25063:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783138102.586585:0:25063:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1783138102.587501:0:25063:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783138102.587691:0:25063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783138102.587707:0:25063:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783138102.587718:0:25063:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x50a9699713c4ce5b 00000020:01000004:2.0:1783138102.587725:0:25063:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783138102.587748:0:25063:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783138102.587751:0:25063:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783138102.587757:0:25063:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783138102.587786:0:25063:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1783138102.587790:0:25063:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1783138102.596498:0:25063:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783138102.596536:0:25063:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1783138102.596540:0:25063:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783138102.596542:0:25063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783138102.596543:0:25063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138102.596544:0:25063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138102.596545:0:25063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138102.596547:0:25063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138102.596548:0:25063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138102.596550:0:25063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138102.596551:0:25063:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783138102.596555:0:25063:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1783138102.596558:0:25063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783138102.596559:0:25063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783138102.596560:0:25063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138102.596561:0:25063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138102.596562:0:25063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138102.596563:0:25063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138102.596564:0:25063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138102.596565:0:25063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138102.596571:0:25063:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783138102.596607:0:25063:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783138102.596627:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175929856:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783138102.596695:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138102.596796:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f07c3f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138102.596840:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175929856 00000100:00100000:1.0:1783138102.596848:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175929856 00000100:00100000:1.0:1783138102.596904:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783138102.596912:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+21:25063:x1869755175929856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783138102.596941:0:22735:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783138102.596945:0:22735:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1783138102.596949:0:22735:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783138102.597288:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+21:25063:x1869755175929856:12345-0@lo:253:mount.lustre.0 Request processed in 374us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.597295:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783138102.597451:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175929856:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783138102.597461:0:25063:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783138102.597463:0:25063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783138102.597464:0:25063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783138102.597465:0:25063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138102.597466:0:25063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138102.597467:0:25063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138102.597468:0:25063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138102.597469:0:25063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138102.597470:0:25063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138102.597472:0:25063:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783138102.597488:0:25063:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e3e040f7000 from lustre-OST0001 10000000:01000000:2.0:1783138102.597517:0:25063:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1783138102.597520:0:25063:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783138102.597530:0:25063:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e3f0445cd40 local copy 00010000:00010000:2.0:1783138102.597541:0:25063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138102.597614:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175929984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138102.597643:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138102.597710:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2aed0600 going to sleep for 11 seconds 00000100:00100000:0.0:1783138102.597745:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175929984 00000100:00100000:0.0:1783138102.597751:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175929984 00000100:00100000:0.0:1783138102.597822:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783138102.597829:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:25063:x1869755175929984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138102.597894:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:25063:x1869755175929984:12345-0@lo:501:mount.lustre.0 Request processed in 65us (250us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783138102.597900:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783138102.597951:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175929984:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783138102.597964:0:25063:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783138102.597979:0:25063:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783138102.597984:0:25063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138102.598002:0:25063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe000/0x50a9699713c4cb75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4cb7c expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138102.598024:0:25063:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e3e040f7000 10000000:01000000:2.0:1783138102.598029:0:25063:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783138102.598033:0:25063:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783138102.598035:0:25063:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783138102.598040:0:25063:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1783138102.598043:0:25063:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783138102.598061:0:25063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478800/0x50a9699713c4ce62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138102.598069:0:25063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478800/0x50a9699713c4ce62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138102.598078:0:25063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478800/0x50a9699713c4ce62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138102.598102:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138102.598128:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138102.598345:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2aed0600 going to sleep for 11 seconds 00000100:00100000:3.0:1783138102.598400:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175930112 00000100:00100000:3.0:1783138102.598405:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175930112 00000100:00100000:0.0:1783138102.598460:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783138102.598468:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:25063:x1869755175930112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783138102.598476:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138102.598488:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4ce69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4ce62 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138102.598508:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4ce69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4ce62 expref: 22 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138102.598518:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e028ffc00/0x50a9699713c4ce69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4ce62 expref: 22 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138102.598536:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028ffc00, rc 0) 00000100:00100000:0.0:1783138102.598564:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+22:25063:x1869755175930112:12345-0@lo:101:mount.lustre.0 Request processed in 98us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138102.598570:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783138102.598637:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138102.598649:0:25063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478800/0x50a9699713c4ce62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce69 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138102.598658:0:25063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478800/0x50a9699713c4ce62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4ce69 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783138102.599594:0:25063:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1783138102.600120:0:25063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783138102.601683:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1783138102.601730:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1783138102.601747:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1783138102.601762:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1783138102.601776:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1783138102.601789:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1783138102.601803:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1783138102.601818:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1783138102.601832:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1783138102.601854:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1783138102.601860:0:25063:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1783138102.601959:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138102.602025:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138102.602486:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f02484d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783138102.602531:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175930240 00000100:00100000:1.0:1783138102.602538:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175930240 00000100:00100000:1.0:1783138102.602580:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783138102.602591:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+22:25063:x1869755175930240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783138102.602785:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+22:25063:x1869755175930240:12345-0@lo:501:mount.lustre.0 Request processed in 194us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.602792:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783138102.602898:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138102.602934:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138102.602977:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138102.603031:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f02484d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783138102.603058:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175930368 00000100:00100000:0.0:1783138102.603062:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175930368 00000100:00100000:1.0:1783138102.603161:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783138102.603168:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+22:25063:x1869755175930368:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138102.603855:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+22:25063:x1869755175930368:12345-0@lo:503:mount.lustre.0 Request processed in 684us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.603872:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783138102.604020:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930368:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783138102.606613:0:25063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783138102.606720:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138102.606809:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138102.606858:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0a2f70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138102.607172:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175930496 00000100:00100000:1.0:1783138102.607180:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175930496 00000100:00100000:1.0:1783138102.607391:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783138102.607403:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+22:25063:x1869755175930496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138102.608128:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+22:25063:x1869755175930496:12345-0@lo:502:mount.lustre.0 Request processed in 723us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138102.608194:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783138102.608451:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1783138102.608482:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1783138102.608499:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1783138102.608515:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1783138102.608526:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1783138102.608537:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1783138102.608549:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1783138102.608561:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1783138102.608573:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1783138102.608605:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930624:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138102.608650:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138102.608675:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0a2f70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138102.608986:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175930624 00000100:00100000:3.0:1783138102.609003:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175930624 00000100:00100000:1.0:1783138102.609195:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783138102.609490:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783138102.609501:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+22:25063:x1869755175930624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138102.609625:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+22:25063:x1869755175930624:12345-0@lo:502:mount.lustre.0 Request processed in 127us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.609632:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783138102.609697:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783138102.609757:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1783138102.609768:0:25063:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1783138102.611397:0:25067:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783138102.611410:0:25067:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1783138102.611415:0:25067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783138102.611418:0:25067:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783138102.611426:0:25067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783138102.611440:0:25067:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e3e03913380) 00000020:00000080:2.0:1783138102.611465:0:25067:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783138102.611471:0:25067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783138102.611569:0:25067:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e3e040f7000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783138102.611579:0:25067:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783138102.611586:0:25067:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x50a9699713c4ce77 00010000:00010000:2.0:1783138102.618493:0:25067:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1783138102.618957:0:25067:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1783138102.622705:0:25067:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1783138102.624484:0:25067:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783138102.624496:0:25067:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138102.624502:0:25067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138102.624504:0:25067:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783138102.624509:0:25067:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783138102.624513:0:25067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138102.624515:0:25067:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783138102.624518:0:25067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783138102.624520:0:25067:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783138102.624522:0:25067:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138102.624524:0:25067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138102.624525:0:25067:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783138102.624528:0:25067:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783138102.624530:0:25067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138102.624531:0:25067:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783138102.624534:0:25067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783138102.624562:0:25067:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783138102.624565:0:25067:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783138102.624566:0:25067:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783138102.624570:0:25067:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1783138102.624762:0:25063:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1783138102.624797:0:25063:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783138102.624816:0:25063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478800/0x50a9699713c4ce62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce69 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138102.624829:0:25063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478800/0x50a9699713c4ce62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce69 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138102.624838:0:25063:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9e3e040f7000 from 1 10000000:01000000:2.0:1783138102.624841:0:25063:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783138102.624876:0:25063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138102.624885:0:25063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138102.624897:0:25063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138102.624924:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783138102.624994:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138102.625046:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f0b347c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783138102.625292:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175930752 00000100:00100000:1.0:1783138102.625299:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175930752 00000100:00100000:1.0:1783138102.625388:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783138102.625398:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+22:25063:x1869755175930752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783138102.625412:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138102.625425:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e041f9400/0x50a9699713c4ce85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4ce7e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.625448:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e041f9400/0x50a9699713c4ce85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4ce7e expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.625459:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e041f9400/0x50a9699713c4ce85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4ce7e expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.625468:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e041f9400, rc 0) 00000100:00100000:1.0:1783138102.625508:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+23:25063:x1869755175930752:12345-0@lo:101:mount.lustre.0 Request processed in 111us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.625515:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783138102.625714:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138102.625730:0:25063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138102.625739:0:25063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783138102.626953:0:25063:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1783138102.627457:0:25063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783138102.627633:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1783138102.627659:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1783138102.627676:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1783138102.627690:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1783138102.627702:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1783138102.627716:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1783138102.627729:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1783138102.627741:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1783138102.627754:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1783138102.627765:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1783138102.627778:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1783138102.627794:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1783138102.627798:0:25063:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1783138102.627867:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138102.627921:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138102.628017:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f099fc000 going to sleep for 11 seconds 00000100:00100000:3.0:1783138102.634851:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175930880 00000100:00100000:3.0:1783138102.634865:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175930880 00000100:00100000:3.0:1783138102.634951:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783138102.634961:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+23:25063:x1869755175930880:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138102.636174:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+23:25063:x1869755175930880:12345-0@lo:501:mount.lustre.0 Request processed in 1207us (8245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.636186:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783138102.636327:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175930880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783138102.636378:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783138102.636423:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.640584:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f09860240 going to sleep for 11 seconds 00000100:00100000:1.0:1783138102.640670:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175931008 00000100:00100000:1.0:1783138102.640681:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175931008 00000100:00100000:1.0:1783138102.640733:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783138102.640742:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+23:25063:x1869755175931008:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783138102.640903:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+23:25063:x1869755175931008:12345-0@lo:503:mount.lustre.0 Request processed in 162us (4478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.640910:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783138102.641012:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931008:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783138102.641630:0:25063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783138102.641722:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138102.641769:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.641791:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f09860240 going to sleep for 11 seconds 00000100:00100000:1.0:1783138102.641859:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175931136 00000100:00100000:1.0:1783138102.641864:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175931136 00000100:00100000:1.0:1783138102.641887:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783138102.641894:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+23:25063:x1869755175931136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783138102.641983:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+23:25063:x1869755175931136:12345-0@lo:502:mount.lustre.0 Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.642009:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783138102.643273:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138102.643554:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1783138102.643585:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1783138102.643598:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1783138102.643611:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1783138102.643626:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1783138102.643640:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1783138102.643653:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1783138102.643665:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1783138102.643679:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1783138102.643705:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1783138102.643719:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1783138102.643751:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138102.643807:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.643835:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f09860240 going to sleep for 11 seconds 00000100:00100000:3.0:1783138102.644174:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175931264 00000100:00100000:3.0:1783138102.644181:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175931264 00000100:00100000:3.0:1783138102.644234:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783138102.644242:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+23:25063:x1869755175931264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138102.644376:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+23:25063:x1869755175931264:12345-0@lo:502:mount.lustre.0 Request processed in 134us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.644385:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783138102.645240:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138102.645331:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1783138102.645343:0:25063:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783138102.648431:0:25071:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138102.648443:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138102.648446:0:25071:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783138102.648454:0:25071:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e3e040f7000 00000020:00000080:3.0:1783138102.648456:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138102.648464:0:25071:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138102.648466:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138102.648468:0:25071:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783138102.648470:0:25071:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138102.648472:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138102.648473:0:25071:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783138102.648491:0:25071:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e3e040f7000 00000020:00000080:3.0:1783138102.648493:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138102.648551:0:25071:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138102.648555:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138102.648556:0:25071:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783138102.648559:0:25071:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138102.648561:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138102.648562:0:25071:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783138102.648565:0:25071:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e3e040f7000 00000020:00000080:3.0:1783138102.648567:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138102.648599:0:25071:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138102.648602:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138102.648604:0:25071:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783138102.648606:0:25071:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783138102.648609:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138102.648610:0:25071:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783138102.648614:0:25071:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e3e040f7000 00000020:00000080:3.0:1783138102.648616:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783138102.648637:0:25071:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783138102.648640:0:25071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783138102.648641:0:25071:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783138102.648644:0:25071:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1783138102.648723:0:25063:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783138102.648750:0:25063:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783138102.648770:0:25063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138102.648781:0:25063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783138102.648825:0:25063:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783138102.648829:0:25063:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e3e040f7000 10000000:01000000:3.0:1783138102.648832:0:25063:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e3e040f7000 10000000:01000000:3.0:1783138102.648841:0:25063:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783138102.648847:0:25063:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9e3e040f7000 from 1 10000000:01000000:3.0:1783138102.648849:0:25063:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783138102.648885:0:25063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f00030800/0x50a9699713c4ce8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138102.648892:0:25063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f00030800/0x50a9699713c4ce8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138102.648902:0:25063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f00030800/0x50a9699713c4ce8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138102.648928:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783138102.649011:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138102.653545:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175931392 00000100:00100000:2.0:1783138102.653560:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175931392 00000100:00100000:2.0:1783138102.653647:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783138102.653657:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+23:25063:x1869755175931392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783138102.653675:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138102.653695:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4ce93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4ce8c expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138102.653726:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4ce93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4ce8c expref: 24 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138102.653738:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f3f479400/0x50a9699713c4ce93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4ce8c expref: 24 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138102.653747:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f3f479400, rc 0) 00000100:00100000:2.0:1783138102.653829:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175931392:12345-0@lo:101:mount.lustre.0 Request processed in 173us (4830us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138102.653836:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783138102.657215:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f05aa0900 going to sleep for 11 seconds 00000100:00100000:3.0:1783138102.657257:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783138102.657281:0:25063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f00030800/0x50a9699713c4ce8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce93 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138102.657294:0:25063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f00030800/0x50a9699713c4ce8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4ce93 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783138102.658895:0:25063:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1783138102.659339:0:25063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783138102.659532:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1783138102.659556:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1783138102.659570:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1783138102.659581:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1783138102.659592:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1783138102.659604:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1783138102.659628:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1783138102.659641:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1783138102.659653:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1783138102.659665:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1783138102.659677:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1783138102.659706:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1783138102.659723:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1783138102.659738:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1783138102.659752:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1783138102.659765:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1783138102.659779:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1783138102.659791:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1783138102.659802:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1783138102.659814:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1783138102.659825:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1783138102.659837:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1783138102.659851:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1783138102.659865:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1783138102.659879:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1783138102.659892:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1783138102.659904:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1783138102.659932:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1783138102.659948:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1783138102.659962:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1783138102.659976:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1783138102.659987:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000100:00100000:1.0:1783138102.664676:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175931520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138102.664753:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138102.664809:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175931520 00000100:00100000:1.0:1783138102.664816:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175931520 00000100:00100000:1.0:1783138102.664861:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783138102.664870:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175931520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783138102.664902:0:22748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783138102.664946:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175931520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.664953:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783138102.664998:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175931520:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1783138102.665179:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1783138102.665242:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1783138102.665258:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1783138102.665271:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1783138102.665284:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1783138102.665297:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1783138102.665331:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1783138102.665357:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1783138102.665369:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1783138102.665383:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1783138102.665396:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1783138102.665422:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1783138102.665434:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1783138102.665444:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1783138102.665455:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1783138102.665468:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000100:00100000:1.0:1783138102.665757:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175931648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783138102.665792:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138102.665827:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175931648 00000100:00100000:1.0:1783138102.665832:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175931648 00000100:00100000:1.0:1783138102.665856:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783138102.665862:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175931648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783138102.665882:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783138102.665915:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175931648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.665922:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783138102.665953:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175931648:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1783138102.666022:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1783138102.666048:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1783138102.666067:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1783138102.666072:0:25063:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1783138102.666150:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138102.666179:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138102.666392:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f36581d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138102.667762:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175931776 00000100:00100000:2.0:1783138102.667772:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175931776 00000100:00100000:2.0:1783138102.671364:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783138102.671383:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175931776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783138102.671558:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175931776:12345-0@lo:501:mount.lustre.0 Request processed in 181us (5377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138102.671566:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783138102.671961:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783138102.672014:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783138102.672063:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138102.672099:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f36581d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138102.672148:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175931904 00000100:00100000:2.0:1783138102.672154:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175931904 00000100:00100000:2.0:1783138102.672251:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783138102.672260:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175931904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783138102.672361:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175931904:12345-0@lo:503:mount.lustre.0 Request processed in 103us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138102.672368:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783138102.672483:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175931904:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783138102.672867:0:25063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783138102.672934:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175932032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138102.672971:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138102.672993:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f36581d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783138102.673009:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175932032 00000100:00100000:3.0:1783138102.673012:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175932032 00000100:00100000:3.0:1783138102.673036:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783138102.673048:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175932032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138102.673130:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175932032:12345-0@lo:502:mount.lustre.0 Request processed in 82us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.673137:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783138102.673177:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175932032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138102.673363:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783138102.673387:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1783138102.673401:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1783138102.673414:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1783138102.673439:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1783138102.673455:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1783138102.673467:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1783138102.673478:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1783138102.673489:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783138102.673501:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1783138102.673514:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1783138102.673526:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1783138102.673537:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1783138102.673549:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1783138102.673561:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1783138102.673574:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1783138102.673587:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1783138102.673598:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1783138102.673609:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1783138102.673620:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1783138102.673643:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1783138102.673656:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1783138102.673668:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1783138102.673681:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1783138102.673694:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1783138102.673718:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1783138102.673730:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1783138102.673743:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1783138102.673755:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1783138102.673767:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1783138102.673778:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1783138102.673791:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1783138102.673803:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1783138102.673816:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1783138102.673828:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1783138102.673841:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1783138102.673865:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1783138102.673880:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1783138102.673894:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1783138102.673914:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1783138102.673926:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1783138102.673938:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1783138102.673951:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1783138102.673963:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1783138102.673976:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1783138102.673994:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1783138102.674007:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1783138102.674020:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1783138102.674058:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175932160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138102.674110:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138102.674148:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f36581d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783138102.674273:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175932160 00000100:00100000:2.0:1783138102.674280:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175932160 00000100:00100000:2.0:1783138102.674346:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783138102.674355:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175932160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783138102.674449:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175932160:12345-0@lo:502:mount.lustre.0 Request processed in 95us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138102.674455:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783138102.674519:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175932160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783138102.674667:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1783138102.674689:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1783138102.674709:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175932288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783138102.674741:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.674758:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e02a56e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783138102.676651:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175932288 00000100:00100000:3.0:1783138102.676663:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175932288 00000100:00100000:3.0:1783138102.676726:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783138102.676737:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175932288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783138102.676901:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175932288:12345-0@lo:502:mount.lustre.0 Request processed in 166us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.676917:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783138102.676982:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175932288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783138102.677061:0:25063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1783138102.677074:0:25063:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783138102.679445:0:25076:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783138102.679464:0:25076:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e3e01f18000) 00000020:00000080:3.0:1783138102.679491:0:25076:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1783138102.680669:0:25076:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e3e040f7000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783138102.680675:0:25076:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e3e040f7000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783138102.680678:0:25076:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3e040f7000 3 00010000:00080000:3.0:1783138102.680707:0:25076:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3f2f87b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1783138102.682980:0:25076:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1783138102.683076:0:25076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783138102.683122:0:25076:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783138102.683134:0:25076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x50a9699713c4cea1 00000100:00080000:3.0:1783138102.683144:0:25076:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783138102.683150:0:25076:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e3f2f87b000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1783138102.683187:0:25076:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f2a986a00 x1869755175932416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138102.683232:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869755175932416:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783138102.683367:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138102.683425:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175932416 00000100:00100000:3.0:1783138102.683433:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175932416 00000100:00100000:3.0:1783138102.683461:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138102.683469:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1869755175932416:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783138102.683490:0:22744:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 764 last 0 00000020:00000080:3.0:1783138102.683535:0:22744:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x50a9699713c4cea8 00000004:00100000:3.0:1783138102.683550:0:22744:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783138102.683578:0:22744:0:(import.c:65:import_set_state_nolock()) ffff9e3f1f986000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783138102.683626:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1869755175932416:12345-0@lo:38:llog_process_th.0 Request processed in 156us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.683634:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783138102.683668:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f2a986a00 x1869755175932416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138102.683678:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783138102.683686:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1783138102.683692:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783138102.683696:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783138102.683697:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f2f87b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783138102.683702:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2a986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1869755175932416:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1783138102.683720:0:25076:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783138102.683742:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138102.683747:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138102.683750:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138102.683753:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138102.683782:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138102.683786:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783138102.683788:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783138102.683792:0:16974:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 763 00000100:00080000:3.0:1783138102.683794:0:16974:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783138102.683804:0:16974:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e3f340c6000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1783138102.683819:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e04333100 x1869755175932800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783138102.683871:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175932544:0@lo:400:kworker.0 00000100:00100000:3.0:1783138102.683897:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138102.683915:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869755175933184:0@lo:400:kworker.0 00000100:00100000:3.0:1783138102.683933:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138102.683953:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783138102.683959:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175932672:0@lo:400:kworker.0 00000100:00100000:3.0:1783138102.683982:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138102.684009:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869755175932928:0@lo:400:kworker.0 00000100:00100000:3.0:1783138102.684032:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138102.684047:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783138102.684052:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869755175933056:0@lo:400:kworker.0 00000100:00100000:3.0:1783138102.684071:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138102.684095:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175932544 00000100:00100000:3.0:1783138102.684099:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175932544 00000100:00100000:3.0:1783138102.684122:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175933184 00000100:00100000:3.0:1783138102.684125:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175933184 00000100:00100000:3.0:1783138102.684135:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175932928 00000100:00100000:3.0:1783138102.684137:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175932928 00000100:00100000:3.0:1783138102.684146:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175933056 00000100:00100000:3.0:1783138102.684148:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175933056 00000100:00100000:3.0:1783138102.684159:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783138102.684165:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175932544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138102.685707:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175932544:12345-0@lo:400:kworker.0 Request processed in 1534us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.685730:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783138102.685757:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783138102.685767:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869755175933184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138102.685827:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869755175933184:12345-0@lo:400:kworker.0 Request processed in 64us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.685833:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783138102.685845:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783138102.685851:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869755175932928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138102.690366:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175932672 00000100:00100000:2.0:1783138102.690381:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175932672 00000100:00100000:2.0:1783138102.690454:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138102.690478:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3660:x1869755175932672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138102.690563:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3660:x1869755175932672:12345-0@lo:400:kworker.0 Request processed in 88us (6580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138102.690571:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783138102.690596:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783138102.690605:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869755175933056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138102.691176:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1869755175932928:12345-0@lo:400:kworker.0 Request processed in 5320us (7138us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.691185:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783138102.691420:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3e04332d80 x1869755175932672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783138118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138102.691438:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175932672:0@lo:400:kworker.0 00010000:00080000:3.0:1783138102.691452:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3e04331880 x1869755175932544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138102.691461:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175932544:0@lo:400:kworker.0 00010000:00080000:3.0:1783138102.691472:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3e04332680 x1869755175933184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138102.691479:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869755175933056:12345-0@lo:400:kworker.0 Request processed in 875us (7407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138102.691480:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869755175933184:0@lo:400:kworker.0 00000100:00100000:2.0:1783138102.691486:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783138102.691514:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e04333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175932800:0@lo:8:kworker.0 00000100:00100000:2.0:1783138102.691554:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138102.691738:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175932800 00000100:00100000:0.0:1783138102.691744:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175932800 00000100:00100000:0.0:1783138102.691773:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138102.691778:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3657:x1869755175932800:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1783138102.691831:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3657:x1869755175932800:12345-0@lo:8:kworker.0 Request processed in 51us (276us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783138102.691837:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138102.691891:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783138102.691897:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783138102.691902:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783138102.691905:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175932800:0@lo:8:kworker.0 00010000:00080000:1.0:1783138102.694301:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3e04333480 x1869755175932928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138102.695420:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1869755175932928:0@lo:400:kworker.0 00010000:00080000:1.0:1783138102.695481:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3e04332a00 x1869755175933056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138102.695491:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869755175933056:0@lo:400:kworker.0 00000020:01000004:0.0:1783138102.695678:0:25076:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783138102.695695:0:25076:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9e3e02710000) 00000020:00000080:0.0:1783138102.695719:0:25076:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1783138102.695888:0:25076:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e3e040f7000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783138102.695893:0:25076:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e3e040f7000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783138102.695895:0:25076:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9e3e040f7000 3 00010000:00080000:0.0:1783138102.695920:0:25076:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e3f3e298800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1783138102.698126:0:25076:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1783138102.698264:0:25076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1783138102.698308:0:25076:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783138102.698333:0:25076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x50a9699713c4ceb6 00000100:00080000:0.0:1783138102.698342:0:25076:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783138102.698347:0:25076:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e3f3e298800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1783138102.698378:0:25076:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f0ac9ce00 x1869755175933312/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783138102.698398:0:25076:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783138102.698425:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138102.698430:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783138102.698438:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783138102.698441:0:16974:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783138102.700697:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1869755175933312:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783138102.700776:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1783138102.701091:0:25076:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1783138102.701371:0:25063:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783138102.701403:0:25063:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783138102.701422:0:25063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f00030800/0x50a9699713c4ce8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce93 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.701434:0:25063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f00030800/0x50a9699713c4ce8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4ce93 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783138102.701486:0:25063:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783138102.701488:0:25063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783138102.701490:0:25063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138102.701491:0:25063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138102.701492:0:25063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138102.701494:0:25063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138102.701496:0:25063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783138102.701498:0:25063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138102.701499:0:25063:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783138102.701503:0:25063:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1783138102.701506:0:25063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783138102.701507:0:25063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783138102.701508:0:25063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783138102.701509:0:25063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783138102.701511:0:25063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783138102.701512:0:25063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783138102.701513:0:25063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783138102.701514:0:25063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783138102.701515:0:25063:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783138102.701537:0:25063:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783138102.701558:0:25063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175933440:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783138102.701607:0:25063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138102.701633:0:25063:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f02bcd300 going to sleep for 11 seconds 00000100:00100000:0.0:1783138102.703010:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175933312 00000100:00100000:0.0:1783138102.703021:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175933312 00000100:00100000:0.0:1783138102.703065:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138102.703073:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1869755175933312:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783138102.703102:0:22743:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 764 last 0 00000020:00000080:0.0:1783138102.703144:0:22743:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x50a9699713c4cebd 00000004:00100000:0.0:1783138102.703160:0:22743:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783138102.703194:0:22743:0:(import.c:65:import_set_state_nolock()) ffff9e3f3e29d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138102.703281:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1869755175933312:12345-0@lo:38:llog_process_th.0 Request processed in 207us (2505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138102.703288:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783138102.703357:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175933440 00000100:00100000:0.0:1783138102.703361:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175933440 00000100:00100000:0.0:1783138102.703393:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783138102.703400:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175933440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783138102.703421:0:22736:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783138102.703435:0:22736:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1783138102.703695:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e3f0ac9ce00 x1869755175933312/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783138112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138102.703707:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783138102.703716:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1783138102.703724:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783138102.703728:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783138102.703731:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f3e298800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783138102.703744:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1869755175933312:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1783138102.708255:0:22736:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783138102.708288:0:22736:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783138102.708598:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:25063:x1869755175933440:12345-0@lo:253:mount.lustre.0 Request processed in 5194us (6986us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138102.708610:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 20000000:01000000:1.0:1783138102.708852:0:22758:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783138102.708858:0:22758:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783138102.708877:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.708892:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3f341fe800/0x50a9699713c4ce38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4ce31 expref: 23 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.708900:0:22758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3f00031400/0x50a9699713c4ce46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4ce3f expref: 23 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.708907:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.708945:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3f00031400/0x50a9699713c4ce46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4ce3f expref: 23 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.708960:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3f00031400/0x50a9699713c4ce46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4ce3f expref: 23 pid: 22736 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138102.708975:0:22758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362db800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175933568:0@lo:104: 00000100:00100000:1.0:1783138102.709013:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783138102.709060:0:22758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3f341fe800/0x50a9699713c4ce38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4ce31 expref: 23 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709069:0:22758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3f341fe800/0x50a9699713c4ce38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4ce31 expref: 23 pid: 22736 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138102.709225:0:22758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362db100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175933696:0@lo:104: 00000100:00100000:1.0:1783138102.709303:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138102.709344:0:22758:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f18247240 going to sleep for 11 seconds 00000100:00100000:1.0:1783138102.709365:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175933568 00000100:00100000:1.0:1783138102.709371:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175933568 00000100:00100000:1.0:1783138102.709406:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175933696 00000100:00100000:1.0:1783138102.709409:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175933696 00000100:00100000:1.0:1783138102.709422:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138102.709430:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff132a53-abfa-4987-a345-1706880f10ac+4:22758:x1869755175933568:12345-0@lo:104: 00000100:00100000:2.0:1783138102.709441:0:25063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff132a53-abfa-4987-a345-1706880f10ac:25063:1869755175933440:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1783138102.709442:0:22726:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138102.709452:0:25063:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783138102.709456:0:25063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783138102.709457:0:25063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783138102.709459:0:25063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783138102.709460:0:25063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783138102.709461:0:25063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783138102.709463:0:25063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783138102.709464:0:25063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783138102.709466:0:25063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783138102.709468:0:25063:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1783138102.709483:0:22726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000020:02000000:2.0:1783138102.709484:0:25063:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1783138102.709488:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff132a53-abfa-4987-a345-1706880f10ac+4:22758:x1869755175933568:12345-0@lo:104: Request processed in 60us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.709494:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138102.709507:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783138102.709512:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff132a53-abfa-4987-a345-1706880f10ac+3:22758:x1869755175933696:12345-0@lo:104: 00010000:00010000:1.0:1783138102.709519:0:22726:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709547:0:22726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783138102.709551:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff132a53-abfa-4987-a345-1706880f10ac+3:22758:x1869755175933696:12345-0@lo:104: Request processed in 40us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.709556:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1783138102.709570:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783138102.709574:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709587:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f341ff000 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:1.0:1783138102.709590:0:22731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709598:0:22731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138102.709604:0:22731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138102.709610:0:22731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783138102.709637:0:22731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709644:0:22731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783138102.709668:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709675:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f341ff000/0x50a9699713c4ce3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4ce46 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709687:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138102.709690:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709696:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028ffe00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:1.0:1783138102.709699:0:22731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709715:0:22731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783138102.709721:0:22731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138102.709726:0:22731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783138102.709737:0:22731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709743:0:22731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783138102.709758:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709765:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4ce31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4ce38 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.709776:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138102.709778:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138102.709780:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138102.709786:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138102.709803:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff132a53-abfa-4987-a345-1706880f10ac:3661:1869755175933824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783138102.709829:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138102.709867:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783138102.709876:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175933952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783138102.709896:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138102.709925:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175933824 00000100:00100000:1.0:1783138102.709929:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175933824 00010000:00010000:1.0:1783138102.709951:0:22729:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3f00031400/0x50a9699713c4ce46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4ce3f expref: 24 pid: 22736 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138102.709969:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175933952 00000100:00100000:1.0:1783138102.709971:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175933952 00010000:00010000:1.0:1783138102.709979:0:22729:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3f341fe800/0x50a9699713c4ce38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4ce31 expref: 25 pid: 22736 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138102.709989:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138102.709994:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff132a53-abfa-4987-a345-1706880f10ac+25:3661:x1869755175933824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138102.710003:0:22729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138102.710008:0:22729:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3f00031400/0x50a9699713c4ce46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4ce3f expref: 25 pid: 22736 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.710017:0:22729:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3f00031400/0x50a9699713c4ce46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4ce3f expref: 25 pid: 22736 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.710031:0:22729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138102.710065:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff132a53-abfa-4987-a345-1706880f10ac+25:3661:x1869755175933824:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.710071:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1783138102.710379:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f00031400/0x50a9699713c4ce46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4ce3f expref: 24 pid: 22736 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138102.710390:0:22758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362db800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175933568:0@lo:104: 00000100:00100000:0.0:1783138102.710398:0:22758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362db100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22758:1869755175933696:0@lo:104: 00010000:00010000:0.0:1783138102.710414:0:22758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138102.710550:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff132a53-abfa-4987-a345-1706880f10ac:3661:1869755175933824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783138102.711306:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783138102.711376:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff132a53-abfa-4987-a345-1706880f10ac+23:3659:x1869755175933952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783138102.711390:0:22729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138102.711396:0:22729:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3f341fe800/0x50a9699713c4ce38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4ce31 expref: 23 pid: 22736 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.711408:0:22729:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3f341fe800/0x50a9699713c4ce38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4ce31 expref: 23 pid: 22736 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.711433:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f341fe800/0x50a9699713c4ce38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4ce31 expref: 23 pid: 22736 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.711447:0:22729:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.711455:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783138102.711469:0:22729:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004365398s 00010000:00010000:1.0:1783138102.711473:0:22729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.711480:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.711486:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.711493:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.711499:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138102.711502:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.711509:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138102.715735:0:22758:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138102.715756:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.715826:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.715850:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e041f8e00/0x50a9699713c4cec4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138102.715867:0:22729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138102.715948:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff132a53-abfa-4987-a345-1706880f10ac+22:3659:x1869755175933952:12345-0@lo:103:ldlm_bl.0 Request processed in 4576us (6047us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138102.715958:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138102.716064:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175933952:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1783138102.719778:0:25063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1783138102.726401:0:25063:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783138102.726409:0:25063:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1783138102.726439:0:25063:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783138102.726480:0:25063:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783138102.726498:0:25063:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1783138102.726519:0:25063:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1783138102.727653:0:25063:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783138102.729655:0:25063:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783138103.097539:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783138103.675118:0:23496:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783138103.739503:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138082/real 1783138082] req@ffff9e3e03b02a00 x1869755175920640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.739542:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3e03b02a00 x1869755175920640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138102 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.739554:0:3657:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783138082/real 1783138082] req@ffff9e3e04333b80 x1869755175920768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.739565:0:3657:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e3e04333b80 x1869755175920768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783138102 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783138103.739601:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e038b4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138103.739630:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783138103.739635:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175920640:0@lo:8:kworker.0 00000100:00080000:0.0:1783138103.739641:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f1f987800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783138103.739646:0:3657:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783138103.739649:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e04333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175920768:0@lo:8:kworker.0 00000100:00080000:2.0:1783138103.739876:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138103.739881:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783138103.739884:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3e038b4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138103.739889:0:16974:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 743 00000100:00080000:2.0:1783138103.739895:0:16974:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783138103.739903:0:16974:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e3e038b4800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138103.739923:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f3f48d500 x1869755175934336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138103.739945:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138103.739948:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783138103.739950:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3f1f987800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138103.739953:0:16974:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 743 00000100:00080000:2.0:1783138103.739956:0:16974:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783138103.739959:0:16974:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e3f1f987800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138103.739969:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3f3f48e680 x1869755175934464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783138103.739996:0:16974:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783138103.739998:0:16974:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783138103.740000:0:16974:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783138103.740004:0:16974:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e3f340c6000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1783138103.740015:0:16974:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e3e03b02d80 x1869755175934976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783138103.740074:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175934720:0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.740167:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.740218:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869755175935360:0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.740247:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.740271:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783138103.740276:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175934080:0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.740308:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.740377:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175934848:0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.740405:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.740433:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869755175935488:0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.740462:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.740619:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175934208:0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.740650:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.740672:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175935104:0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.740696:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.740715:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869755175935616:0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.740736:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.740754:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783138103.740760:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175934592:0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.740782:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.740791:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175935232:0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.740813:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.740843:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175934720 00000100:00100000:2.0:1783138103.740853:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175934720 00000100:00100000:2.0:1783138103.740908:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175934208 00000100:00100000:2.0:1783138103.740911:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175934208 00000100:00100000:2.0:1783138103.740931:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783138103.740942:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175934720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.741010:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175934720:12345-0@lo:400:kworker.0 Request processed in 68us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.741018:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783138103.741038:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783138103.741044:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175934208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.741079:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175934208:12345-0@lo:400:kworker.0 Request processed in 34us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.741094:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783138103.741114:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175935360 00000100:00100000:2.0:1783138103.741118:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175935360 00000100:00100000:2.0:1783138103.741138:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175935488 00000100:00100000:2.0:1783138103.741141:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175935488 00000100:00100000:2.0:1783138103.741163:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175935104 00000100:00100000:2.0:1783138103.741165:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175935104 00000100:00100000:2.0:1783138103.741174:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175935616 00000100:00100000:2.0:1783138103.741176:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175935616 00000100:00100000:2.0:1783138103.741201:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175934592 00000100:00100000:2.0:1783138103.741204:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175934592 00000100:00100000:2.0:1783138103.741216:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175935232 00000100:00100000:2.0:1783138103.741219:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175935232 00000100:00100000:2.0:1783138103.741230:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783138103.741236:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869755175935360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.741266:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869755175935360:12345-0@lo:400:kworker.0 Request processed in 31us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.741272:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783138103.741282:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783138103.741287:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869755175935488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.741309:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1869755175935488:12345-0@lo:400:kworker.0 Request processed in 22us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.741336:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783138103.741346:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783138103.741351:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175935104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.742005:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175935104:12345-0@lo:400:kworker.0 Request processed in 648us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.742015:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783138103.742044:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783138103.742051:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869755175935616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.742088:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869755175935616:12345-0@lo:400:kworker.0 Request processed in 38us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.742094:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783138103.742110:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783138103.742116:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175934592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.742143:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175934592:12345-0@lo:400:kworker.0 Request processed in 28us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.742149:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783138103.742300:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783138103.742307:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175935232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.742455:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175935232:12345-0@lo:400:kworker.0 Request processed in 149us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.742462:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783138103.742488:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175934080 00000100:00100000:0.0:1783138103.742645:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175934336:0@lo:8:kworker.0 00000100:00100000:0.0:1783138103.742695:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138103.742733:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175934464:0@lo:8:kworker.0 00000100:00100000:0.0:1783138103.742754:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138103.742770:0:3657:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175934976:0@lo:8:kworker.0 00000100:00100000:0.0:1783138103.742788:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138103.742821:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175934848 00000100:00100000:0.0:1783138103.742828:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175934848 00000100:00100000:0.0:1783138103.742856:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175934336 00000100:00100000:0.0:1783138103.742858:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175934336 00000100:00100000:0.0:1783138103.742866:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175934464 00000100:00100000:0.0:1783138103.742868:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175934464 00000100:00100000:0.0:1783138103.742874:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175934976 00000100:00100000:0.0:1783138103.742875:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175934976 00000100:00100000:0.0:1783138103.742883:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783138103.742890:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3658:x1869755175934848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138103.742920:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3658:x1869755175934848:12345-0@lo:400:kworker.0 Request processed in 31us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138103.742926:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783138103.742944:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783138103.742948:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1869755175934336:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783138103.742983:0:24249:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 765 last 0 00000020:00000080:0.0:1783138103.743025:0:24249:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50a9699713c4cecb 00002000:00100000:0.0:1783138103.743044:0:24249:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e3f3e29c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113655 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783138103.743049:0:24249:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783138103.743053:0:24249:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783138103.743138:0:24249:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783138103.743204:0:24249:0:(import.c:65:import_set_state_nolock()) ffff9e3f3e29e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138103.743241:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1869755175934336:12345-0@lo:8:kworker.0 Request processed in 291us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138103.743248:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783138103.743258:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138103.743262:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1869755175934464:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783138103.743277:0:24249:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 765 last 0 00000020:00000080:0.0:1783138103.743294:0:24249:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x50a9699713c4ced2 00002000:00100000:0.0:1783138103.743300:0:24249:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e3f3e29a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113655 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783138103.743303:0:24249:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783138103.743306:0:24249:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783138103.743655:0:24249:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783138103.743675:0:24249:0:(import.c:65:import_set_state_nolock()) ffff9e3f3e29d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138103.743707:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1869755175934464:12345-0@lo:8:kworker.0 Request processed in 443us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138103.743714:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138103.743728:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138103.743732:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1869755175934976:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783138103.743754:0:24249:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 765 last 0 00000020:00000080:0.0:1783138103.743769:0:24249:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x50a9699713c4ced9 00002000:00100000:0.0:1783138103.743776:0:24249:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9e3f3e29b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113655 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1783138103.743780:0:24249:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1783138103.743782:0:24249:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783138103.743802:0:24249:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1783138103.743813:0:24249:0:(import.c:65:import_set_state_nolock()) ffff9e3f3e29b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783138103.743836:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3657:x1869755175934976:12345-0@lo:8:kworker.0 Request processed in 103us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138103.743842:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1783138103.743889:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f3f48d500 x1869755175934336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783138128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.743902:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783138103.743911:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1783138103.743919:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783138103.743924:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783138103.743927:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3e038b4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783138103.743947:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783138103.743952:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175934336:0@lo:8:kworker.0 00010000:00080000:0.0:1783138103.743964:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f3f48e680 x1869755175934464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783138128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.743972:0:3657:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783138103.743975:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1783138103.743980:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783138103.743983:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783138103.743992:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f1f987800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783138103.744008:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783138103.744012:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1869755175934464:0@lo:8:kworker.0 00010000:00080000:0.0:1783138103.744026:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e03b02d80 x1869755175934976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783138128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783138103.744037:0:3657:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1783138103.744043:0:3657:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783138103.744047:0:3657:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783138103.744049:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9e3f340c6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783138103.744061:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783138103.744064:0:3657:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1869755175934976:0@lo:8:kworker.0 00000004:00080000:0.0:1783138103.744138:0:22769:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1783138103.744162:0:22769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22769:1869755175935872:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783138103.744264:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175934080 00000100:00100000:2.0:1783138103.744307:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783138103.744325:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+22:3658:x1869755175934080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138103.744456:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+22:3658:x1869755175934080:12345-0@lo:400:kworker.0 Request processed in 50us (4055us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.744465:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1783138103.744586:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783138103.744591:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1783138103.744630:0:22767:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1783138103.744644:0:22767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22767:1869755175936128:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783138103.744681:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.744705:0:22767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3e01f79240 going to sleep for 11 seconds 00000004:00080000:2.0:1783138103.744726:0:22768:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783138103.744815:0:22768:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 765478501017ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783138103.744823:0:22768:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1783138103.745041:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175935744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138103.745076:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.745114:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175935744 00000100:00100000:2.0:1783138103.745119:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175935744 00000100:00100000:2.0:1783138103.745160:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783138103.745167:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1869755175935744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783138103.745308:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138103.745336:0:22769:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f07998d80 going to sleep for 11 seconds 00000004:00080000:0.0:1783138103.745349:0:23486:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783138103.745410:0:23486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 765479097028ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783138103.745415:0:23486:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1783138103.745779:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175936128 00000100:00100000:3.0:1783138103.745787:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175936128 00000100:00100000:3.0:1783138103.745822:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175935872 00000100:00100000:3.0:1783138103.745826:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175935872 00000100:00100000:3.0:1783138103.745841:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783138103.745848:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22767:x1869755175936128:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783138103.746126:0:22766:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783138103.746357:0:22766:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 765480043223ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783138103.746364:0:22766:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1783138103.746411:0:23487:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783138103.746435:0:23487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23487:1869755175936384:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1783138103.746804:0:23487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138103.746830:0:23487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2b0bc180 going to sleep for 11 seconds 00002000:00000024:2.0:1783138103.747107:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915874304 avail 3684352000 00000100:00100000:2.0:1783138103.748108:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1869755175935744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2934us (3023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.748125:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783138103.748810:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f0ac9e300 x1869755175935744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138103.748841:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175935744:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783138103.748956:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783138103.748962:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783138103.748983:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175936384 00000100:00100000:2.0:1783138103.748992:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175936384 00000100:00100000:2.0:1783138103.749050:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783138103.749060:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22769:x1869755175935872:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783138103.749343:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175936256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783138103.749413:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138103.749447:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138103.749454:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175936000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783138103.749475:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783138103.750302:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783138103.751423:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175936256 00000100:00100000:2.0:1783138103.751438:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175936256 00000100:00100000:2.0:1783138103.751484:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175936000 00000100:00100000:2.0:1783138103.751488:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175936000 00000100:00100000:2.0:1783138103.752396:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138103.752410:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3659:x1869755175936256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783138103.752450:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915874304 avail 3684352000 00000100:00100000:2.0:1783138103.753379:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3659:x1869755175936256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 967us (3959us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.753391:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138103.753420:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783138103.753428:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1869755175936000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783138103.753453:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783138103.753482:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1869755175936000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (4005us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138103.753487:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783138103.754651:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f3f48d180 x1869755175934592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.754672:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175934592:0@lo:400:kworker.0 00010000:00080000:0.0:1783138103.754744:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e03b01180 x1869755175935232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.754754:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175935232:0@lo:400:kworker.0 00000100:00100000:0.0:1783138103.754770:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175934208:0@lo:400:kworker.0 00010000:00080000:0.0:1783138103.754805:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e03b01880 x1869755175935104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.754814:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175935104:0@lo:400:kworker.0 00010000:00080000:0.0:1783138103.754833:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e03b02680 x1869755175935616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.754840:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869755175935616:0@lo:400:kworker.0 00000100:00100000:0.0:1783138103.754939:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175934080:0@lo:400:kworker.0 00010000:00080000:0.0:1783138103.754955:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e03b03480 x1869755175934848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783138119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.754966:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175934848:0@lo:400:kworker.0 00010000:00080000:0.0:1783138103.754984:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e03b00e00 x1869755175935488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.754993:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1869755175935488:0@lo:400:kworker.0 00000100:00100000:0.0:1783138103.755006:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175934720:0@lo:400:kworker.0 00010000:00080000:0.0:1783138103.755020:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e03b00a80 x1869755175935360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.755029:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869755175935360:0@lo:400:kworker.0 00010000:00080000:2.0:1783138103.755097:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f2f8c4000 x1869755175936000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138103.755122:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175936000:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1783138103.755137:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e0287e680 x1869755175936256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783138119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138103.755150:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175936256:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1783138103.755658:0:23476:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1783138103.757170:0:22722:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1783138103.758401:0:24746:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1783138103.758415:0:24746:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1783138103.758423:0:24746:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00080000:0.0:1783138103.758533:0:24248:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1783138103.758540:0:24248:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1783138103.758544:0:24248:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:2.0:1783138103.758700:0:22722:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1783138103.771488:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.771504:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b69becd7/0x50a9699713c4cee0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.771537:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.771541:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.771548:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b69becd7/0x50a9699713c4cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.771568:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b69becd7/0x50a9699713c4cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.771580:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b69becd7/0x50a9699713c4cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.771588:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b69becd7/0x50a9699713c4cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.771610:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138103.771624:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138103.771630:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b69becd7/0x50a9699713c4cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.771638:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f00031600 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.771643:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b69becd7/0x50a9699713c4cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.771651:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b69becd7/0x50a9699713c4cee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.771679:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b69becd7/0x50a9699713c4cee0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.771687:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b69becd7/0x50a9699713c4cee0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.771706:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.771708:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.771710:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138103.777170:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.777187:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008766d070/0x50a9699713c4cee7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.777218:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.777224:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.777232:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008766d070/0x50a9699713c4cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.777414:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008766d070/0x50a9699713c4cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.777428:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008766d070/0x50a9699713c4cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.777437:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008766d070/0x50a9699713c4cee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.777475:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.778299:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.778326:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008766d070/0x50a9699713c4cee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.778342:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f00030a00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.778347:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008766d070/0x50a9699713c4cee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.778361:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008766d070/0x50a9699713c4cee7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.778396:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008766d070/0x50a9699713c4cee7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.778405:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008766d070/0x50a9699713c4cee7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.778485:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.778490:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.778493:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138103.778860:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.778868:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0667c9/0x50a9699713c4ceee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.778883:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.778887:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.778894:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0667c9/0x50a9699713c4ceee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.778906:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0667c9/0x50a9699713c4ceee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.778916:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0667c9/0x50a9699713c4ceee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.778923:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0667c9/0x50a9699713c4ceee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.778946:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.781781:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.781821:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab0667c9/0x50a9699713c4ceee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.781839:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f00031400 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.781845:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0667c9/0x50a9699713c4ceee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.781859:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0667c9/0x50a9699713c4ceee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.781889:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab0667c9/0x50a9699713c4ceee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.781899:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0667c9/0x50a9699713c4ceee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.781937:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.781940:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.781942:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.783614:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.783632:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4cef5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.783653:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.783658:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.783665:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4cef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.783702:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4cef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.783715:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4cef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.783723:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4cef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.783761:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.784168:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.784179:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4cef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.784199:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.784206:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4cef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.784231:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4cef5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.784252:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4cef5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.784261:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4cef5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.784287:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.784289:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.784293:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138103.785274:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.785290:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4cefc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.785350:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.785355:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.785362:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4cefc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.785376:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4cefc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.785387:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4cefc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.785396:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4cefc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.785419:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.785451:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.785462:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4cefc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.785475:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9200 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.785481:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4cefc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.785502:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4cefc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.785523:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4cefc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.785548:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4cefc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.785572:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.785575:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.785577:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138103.785977:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.786062:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069896dd5/0x50a9699713c4cf03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.786078:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.786082:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.786088:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069896dd5/0x50a9699713c4cf03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.786099:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069896dd5/0x50a9699713c4cf03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.786120:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069896dd5/0x50a9699713c4cf03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.786128:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069896dd5/0x50a9699713c4cf03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.786148:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.786247:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.786255:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069896dd5/0x50a9699713c4cf03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.786265:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9400 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.786268:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069896dd5/0x50a9699713c4cf03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.786277:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069896dd5/0x50a9699713c4cf03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.786290:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069896dd5/0x50a9699713c4cf03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.786297:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069896dd5/0x50a9699713c4cf03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.786353:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.786356:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.786359:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138103.787143:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.787155:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000136f7f96/0x50a9699713c4cf0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.787168:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.787173:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.787178:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000136f7f96/0x50a9699713c4cf0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.787203:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000136f7f96/0x50a9699713c4cf0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.787213:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000136f7f96/0x50a9699713c4cf0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.787219:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000136f7f96/0x50a9699713c4cf0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.787456:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.787514:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.787524:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000136f7f96/0x50a9699713c4cf0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.787537:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.787543:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000136f7f96/0x50a9699713c4cf0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.787554:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000136f7f96/0x50a9699713c4cf0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.787573:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000136f7f96/0x50a9699713c4cf0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.787582:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000136f7f96/0x50a9699713c4cf0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.787603:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.787604:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.787606:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138103.790374:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.790388:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c19ec98/0x50a9699713c4cf11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.790405:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.790409:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.790415:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c19ec98/0x50a9699713c4cf11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.790429:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c19ec98/0x50a9699713c4cf11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.790439:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c19ec98/0x50a9699713c4cf11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.790448:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c19ec98/0x50a9699713c4cf11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.790481:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138103.790526:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.790540:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c19ec98/0x50a9699713c4cf11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.790554:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8000 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.790560:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c19ec98/0x50a9699713c4cf11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.790574:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c19ec98/0x50a9699713c4cf11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.790601:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c19ec98/0x50a9699713c4cf11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.790610:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c19ec98/0x50a9699713c4cf11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.790637:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.790639:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.790640:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.791172:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.791189:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fa20dbf/0x50a9699713c4cf18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.791214:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.791220:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.791227:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fa20dbf/0x50a9699713c4cf18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.791245:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fa20dbf/0x50a9699713c4cf18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.791255:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fa20dbf/0x50a9699713c4cf18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.791280:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fa20dbf/0x50a9699713c4cf18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.791336:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138103.791438:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138103.791449:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fa20dbf/0x50a9699713c4cf18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.791464:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f478c00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.791480:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fa20dbf/0x50a9699713c4cf18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.791492:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fa20dbf/0x50a9699713c4cf18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.791514:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fa20dbf/0x50a9699713c4cf18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.791522:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fa20dbf/0x50a9699713c4cf18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.791544:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.791545:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.791547:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.793005:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1783138103.793018:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.793021:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000755c4868/0x50a9699713c4cf1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793035:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000315c7910/0x50a9699713c4cf26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.793045:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.793052:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.793053:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.793071:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.793074:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000755c4868/0x50a9699713c4cf1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793082:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000315c7910/0x50a9699713c4cf26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793097:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000315c7910/0x50a9699713c4cf26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793107:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000315c7910/0x50a9699713c4cf26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793127:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000315c7910/0x50a9699713c4cf26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793150:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138103.793228:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.793239:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000315c7910/0x50a9699713c4cf26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.793267:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8a00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.793272:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000315c7910/0x50a9699713c4cf26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.793285:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000315c7910/0x50a9699713c4cf26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.793309:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000315c7910/0x50a9699713c4cf26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.793335:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000315c7910/0x50a9699713c4cf26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.793364:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.793367:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.793369:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.793711:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000755c4868/0x50a9699713c4cf1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.793721:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000755c4868/0x50a9699713c4cf1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.793728:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000755c4868/0x50a9699713c4cf1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.793757:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783138103.793769:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.793778:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4cf2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793789:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.793793:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.793798:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4cf2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793810:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4cf2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793821:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4cf2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793829:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4cf2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793854:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783138103.793868:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138103.793876:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000755c4868/0x50a9699713c4cf1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793899:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479800 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.793905:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000755c4868/0x50a9699713c4cf1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793915:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000755c4868/0x50a9699713c4cf1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793936:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000755c4868/0x50a9699713c4cf1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793944:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000755c4868/0x50a9699713c4cf1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793965:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138103.793969:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4cf2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.793975:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9c00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.793978:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4cf2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.794051:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4cf2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.794064:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4cf2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.794081:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4cf2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.794097:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.794099:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.794100:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.794283:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.794677:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.794686:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cf34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.794710:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.794715:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.794721:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cf34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.794732:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cf34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.794742:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cf34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.794751:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cf34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.794771:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138103.795088:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.795094:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cf34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.795103:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479600 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.795108:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cf34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.795128:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cf34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.795148:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cf34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.795168:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cf34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.795202:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.795204:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.795205:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138103.795525:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.795539:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000591accee/0x50a9699713c4cf3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.795556:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.795561:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.795566:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000591accee/0x50a9699713c4cf3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.795578:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000591accee/0x50a9699713c4cf3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.795587:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000591accee/0x50a9699713c4cf3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.795594:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000591accee/0x50a9699713c4cf3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.795624:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138103.796397:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.796410:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046f5521a/0x50a9699713c4cf42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.796424:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.796428:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.796434:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046f5521a/0x50a9699713c4cf42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.796446:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046f5521a/0x50a9699713c4cf42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.796470:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046f5521a/0x50a9699713c4cf42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.796477:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046f5521a/0x50a9699713c4cf42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.796618:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783138103.796864:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.796889:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4cf49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.796905:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.796910:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.796917:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4cf49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.796931:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4cf49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.796939:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4cf49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.796946:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4cf49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783138103.800922:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.800944:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cf50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.800967:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.800973:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.800981:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cf50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.801017:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cf50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.801030:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cf50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.801039:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cf50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801445:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783138103.801455:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000591accee/0x50a9699713c4cf3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801466:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8400 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.801472:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000591accee/0x50a9699713c4cf3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801483:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000591accee/0x50a9699713c4cf3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801516:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000591accee/0x50a9699713c4cf3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801538:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000591accee/0x50a9699713c4cf3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801594:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783138103.801599:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046f5521a/0x50a9699713c4cf42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801605:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f478000 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.801608:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046f5521a/0x50a9699713c4cf42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801615:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046f5521a/0x50a9699713c4cf42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801626:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046f5521a/0x50a9699713c4cf42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801633:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046f5521a/0x50a9699713c4cf42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801648:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138103.801652:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4cf49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801658:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9800 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.801668:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4cf49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801677:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4cf49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801688:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4cf49 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801695:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.801699:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cf50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801705:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.801708:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cf50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801714:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cf50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801723:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cf50 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.801732:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.801734:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.801736:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.804138:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783138103.804157:0:24746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4cf49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.805899:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138103.805903:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.805919:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b7bfedb/0x50a9699713c4cf57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.805937:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.805941:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.805955:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b7bfedb/0x50a9699713c4cf57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.805969:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b7bfedb/0x50a9699713c4cf57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.805979:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b7bfedb/0x50a9699713c4cf57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.805987:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b7bfedb/0x50a9699713c4cf57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.806063:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783138103.806124:0:24248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cf50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783138103.806851:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.806861:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001660895c/0x50a9699713c4cf5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.806875:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.806880:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.806886:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001660895c/0x50a9699713c4cf5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.806899:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001660895c/0x50a9699713c4cf5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.806921:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001660895c/0x50a9699713c4cf5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.806928:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001660895c/0x50a9699713c4cf5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.806938:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783138103.807360:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.807369:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c22a548/0x50a9699713c4cf65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.807379:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.807382:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.807386:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c22a548/0x50a9699713c4cf65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.807396:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c22a548/0x50a9699713c4cf65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.807405:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c22a548/0x50a9699713c4cf65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.807412:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c22a548/0x50a9699713c4cf65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.807434:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783138103.807654:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138103.807663:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001660895c/0x50a9699713c4cf5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.807674:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8a00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.807679:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001660895c/0x50a9699713c4cf5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.807689:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001660895c/0x50a9699713c4cf5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.807710:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001660895c/0x50a9699713c4cf5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.807717:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001660895c/0x50a9699713c4cf5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.807738:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.807742:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c22a548/0x50a9699713c4cf65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.807748:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8800 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.807751:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c22a548/0x50a9699713c4cf65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.807759:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c22a548/0x50a9699713c4cf65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.807780:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c22a548/0x50a9699713c4cf65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.807787:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c22a548/0x50a9699713c4cf65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.807800:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.807802:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.807804:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.808280:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.808291:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff87a67f/0x50a9699713c4cf6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.808302:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.808306:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.808398:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff87a67f/0x50a9699713c4cf6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.808411:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff87a67f/0x50a9699713c4cf6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.808421:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff87a67f/0x50a9699713c4cf6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.808429:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff87a67f/0x50a9699713c4cf6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.808482:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783138103.808788:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138103.808796:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff87a67f/0x50a9699713c4cf6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.808805:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9200 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138103.808810:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff87a67f/0x50a9699713c4cf6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.808819:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff87a67f/0x50a9699713c4cf6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.808834:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff87a67f/0x50a9699713c4cf6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.808840:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff87a67f/0x50a9699713c4cf6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.808858:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.808887:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.808889:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.809065:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.809072:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008256d24b/0x50a9699713c4cf73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.809090:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.809100:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.809105:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008256d24b/0x50a9699713c4cf73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.809115:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008256d24b/0x50a9699713c4cf73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.809123:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008256d24b/0x50a9699713c4cf73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.809130:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008256d24b/0x50a9699713c4cf73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.809149:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783138103.809330:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138103.809336:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008256d24b/0x50a9699713c4cf73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.809343:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8600 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138103.809348:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008256d24b/0x50a9699713c4cf73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.809356:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008256d24b/0x50a9699713c4cf73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.809367:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008256d24b/0x50a9699713c4cf73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.809375:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008256d24b/0x50a9699713c4cf73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.809390:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.809392:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.809393:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.809845:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.809854:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000694703ee/0x50a9699713c4cf7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.809864:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.809868:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.809873:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000694703ee/0x50a9699713c4cf7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.809883:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000694703ee/0x50a9699713c4cf7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.809892:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000694703ee/0x50a9699713c4cf7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.809906:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000694703ee/0x50a9699713c4cf7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.809929:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138103.810202:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783138103.810285:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138103.810292:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000694703ee/0x50a9699713c4cf7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.810301:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9800 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138103.810306:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000694703ee/0x50a9699713c4cf7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.810345:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000694703ee/0x50a9699713c4cf7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.810359:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000694703ee/0x50a9699713c4cf7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.810366:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000694703ee/0x50a9699713c4cf7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.810387:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138103.810393:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b7bfedb/0x50a9699713c4cf57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.810400:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8600 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138103.810404:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b7bfedb/0x50a9699713c4cf57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.810412:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b7bfedb/0x50a9699713c4cf57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.810423:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b7bfedb/0x50a9699713c4cf57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.810431:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b7bfedb/0x50a9699713c4cf57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.810467:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.810469:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.810472:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.810739:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.810748:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004931eed/0x50a9699713c4cf81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.810758:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.810762:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.810767:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004931eed/0x50a9699713c4cf81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.810777:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004931eed/0x50a9699713c4cf81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.810787:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004931eed/0x50a9699713c4cf81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.810794:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004931eed/0x50a9699713c4cf81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.810818:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783138103.811421:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.811430:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024b32375/0x50a9699713c4cf88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.811447:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.811451:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.811456:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024b32375/0x50a9699713c4cf88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.811468:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024b32375/0x50a9699713c4cf88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.811477:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024b32375/0x50a9699713c4cf88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.811485:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024b32375/0x50a9699713c4cf88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.811865:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138103.811873:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004931eed/0x50a9699713c4cf81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.811883:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9000 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138103.811888:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004931eed/0x50a9699713c4cf81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.811899:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004931eed/0x50a9699713c4cf81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.811917:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004931eed/0x50a9699713c4cf81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.811925:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004931eed/0x50a9699713c4cf81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.811941:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.811943:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.811945:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.812018:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783138103.812788:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.812800:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3db995b/0x50a9699713c4cf8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.812813:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.812817:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.812824:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3db995b/0x50a9699713c4cf8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.812838:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3db995b/0x50a9699713c4cf8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.812862:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3db995b/0x50a9699713c4cf8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.812871:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3db995b/0x50a9699713c4cf8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.812945:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138103.812953:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024b32375/0x50a9699713c4cf88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.812976:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9a00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138103.812981:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024b32375/0x50a9699713c4cf88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.812991:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024b32375/0x50a9699713c4cf88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.813009:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024b32375/0x50a9699713c4cf88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.813016:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024b32375/0x50a9699713c4cf88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.813041:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.813112:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.813237:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3db995b/0x50a9699713c4cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.813247:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8200 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138103.813251:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3db995b/0x50a9699713c4cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.813259:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3db995b/0x50a9699713c4cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.813269:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3db995b/0x50a9699713c4cf8f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.813284:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.813286:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.813288:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.814471:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783138103.814545:0:24746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3db995b/0x50a9699713c4cf8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.815261:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.817455:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.817476:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000420653d6/0x50a9699713c4cf96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.817509:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.817514:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.817523:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000420653d6/0x50a9699713c4cf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.817540:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000420653d6/0x50a9699713c4cf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.817553:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000420653d6/0x50a9699713c4cf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.817574:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000420653d6/0x50a9699713c4cf96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.817597:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.817826:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.817833:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000420653d6/0x50a9699713c4cf96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.817842:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8000 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.817847:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000420653d6/0x50a9699713c4cf96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.817857:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000420653d6/0x50a9699713c4cf96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.817878:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000420653d6/0x50a9699713c4cf96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.817886:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000420653d6/0x50a9699713c4cf96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.817908:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.817910:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.817911:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.817970:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.817983:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cf9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.817993:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.817996:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.818000:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cf9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.818010:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cf9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.818018:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cf9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.818027:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cf9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.818045:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.818055:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.818059:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cf9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.818067:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.818070:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cf9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.818077:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cf9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.818097:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cf9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.818105:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cf9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.818119:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.818121:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.818122:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.820885:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.820904:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003196cf5e/0x50a9699713c4cfa4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.820926:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.820931:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.820938:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003196cf5e/0x50a9699713c4cfa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.820954:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003196cf5e/0x50a9699713c4cfa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.820965:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003196cf5e/0x50a9699713c4cfa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.820973:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003196cf5e/0x50a9699713c4cfa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.821016:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138103.821089:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138103.821106:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003196cf5e/0x50a9699713c4cfa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.821120:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9c00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.821125:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003196cf5e/0x50a9699713c4cfa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.821137:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003196cf5e/0x50a9699713c4cfa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.821161:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003196cf5e/0x50a9699713c4cfa4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.821200:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003196cf5e/0x50a9699713c4cfa4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.821227:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.821229:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.821231:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.822143:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.822230:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4cfab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.822246:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.822251:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.822258:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4cfab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.822272:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4cfab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.822282:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4cfab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.822290:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4cfab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.822355:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783138103.822684:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138103.822691:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f76923da/0x50a9699713c4cfb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822700:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=765s v=(0 0) 00010000:00010000:0.0:1783138103.822704:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138103.822708:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f76923da/0x50a9699713c4cfb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822720:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f76923da/0x50a9699713c4cfb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822728:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f76923da/0x50a9699713c4cfb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822748:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f76923da/0x50a9699713c4cfb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822774:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783138103.822788:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138103.822795:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4cfab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822805:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9600 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.822811:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4cfab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822822:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4cfab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822843:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4cfab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822851:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4cfab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822882:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.822886:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f76923da/0x50a9699713c4cfb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822906:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028ff400 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.822910:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f76923da/0x50a9699713c4cfb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822918:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f76923da/0x50a9699713c4cfb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822931:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f76923da/0x50a9699713c4cfb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822938:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f76923da/0x50a9699713c4cfb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.822956:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.822958:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.822960:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783138103.823741:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138103.823751:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bae502a/0x50a9699713c4cfb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.823765:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=765s v=(0 0) 00010000:00010000:0.0:1783138103.823770:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138103.823775:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bae502a/0x50a9699713c4cfb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.823788:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bae502a/0x50a9699713c4cfb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.823805:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bae502a/0x50a9699713c4cfb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.823813:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bae502a/0x50a9699713c4cfb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.823838:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138103.824366:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138103.824380:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bae502a/0x50a9699713c4cfb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.824394:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028ff000 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.824398:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bae502a/0x50a9699713c4cfb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.824409:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bae502a/0x50a9699713c4cfb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.824434:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bae502a/0x50a9699713c4cfb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.824441:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bae502a/0x50a9699713c4cfb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.824471:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.824474:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.824477:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.826644:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.826663:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004074d008/0x50a9699713c4cfc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.826686:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.826706:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.826715:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004074d008/0x50a9699713c4cfc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.826733:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004074d008/0x50a9699713c4cfc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.826744:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004074d008/0x50a9699713c4cfc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.826753:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004074d008/0x50a9699713c4cfc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.826782:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138103.826830:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138103.826845:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004074d008/0x50a9699713c4cfc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.826858:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8c00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.826863:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004074d008/0x50a9699713c4cfc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.826873:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004074d008/0x50a9699713c4cfc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.826895:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004074d008/0x50a9699713c4cfc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.826903:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004074d008/0x50a9699713c4cfc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.826934:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.826937:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.826939:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.827069:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783138103.827343:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138103.827352:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5ad4262/0x50a9699713c4cfc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.827364:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=765s v=(0 0) 00010000:00010000:0.0:1783138103.827367:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138103.827373:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ad4262/0x50a9699713c4cfc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.827385:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5ad4262/0x50a9699713c4cfc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.827394:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5ad4262/0x50a9699713c4cfc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.827404:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ad4262/0x50a9699713c4cfc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.827502:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138103.828590:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.828605:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5ad4262/0x50a9699713c4cfc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.828621:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028fec00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.828627:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5ad4262/0x50a9699713c4cfc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.828638:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5ad4262/0x50a9699713c4cfc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.828663:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5ad4262/0x50a9699713c4cfc7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.828671:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5ad4262/0x50a9699713c4cfc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.828697:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.828699:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.828701:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.828881:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.828891:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4cfce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.828904:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.828908:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.828915:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4cfce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.828930:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4cfce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.828940:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4cfce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.828948:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4cfce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.828966:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.829160:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.829168:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4cfce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.829177:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f478e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.829181:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4cfce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.829197:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4cfce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.829213:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4cfce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.829234:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4cfce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.829253:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.829255:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.829257:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.829348:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.829354:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cfd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.829364:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.829368:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.829373:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cfd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.829382:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cfd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.829389:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cfd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.829396:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cfd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.829410:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138103.829624:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.829632:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cfd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.829641:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.829652:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cfd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.829661:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cfd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.829674:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cfd5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.829683:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025f5a17c/0x50a9699713c4cfd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.829705:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.829707:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.829708:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.831363:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.831383:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4cfdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.831416:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.831421:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.831429:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4cfdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.831445:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4cfdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.831455:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4cfdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.831463:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4cfdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.831753:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.832289:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.832305:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4cfdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.832353:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f478000 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.832359:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4cfdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.832370:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4cfdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.832393:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4cfdc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.832400:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4cfdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.832425:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.832427:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.832429:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.832803:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.832814:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cfe3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.832825:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.832830:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.832836:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cfe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.832863:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cfe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.832873:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cfe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.832880:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cfe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.832907:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138103.833672:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.833684:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4cfea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.833700:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.833705:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.833711:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4cfea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.833726:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4cfea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.833750:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4cfea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.833757:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4cfea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.833784:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783138103.834124:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138103.834133:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cfe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.834142:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.834147:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cfe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.834156:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cfe3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.834175:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cfe3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.834208:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4cfe3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.834234:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.834238:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4cfea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.834245:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479800 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.834248:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4cfea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.834256:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4cfea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.834267:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4cfea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.834273:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4cfea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.834286:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.834288:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.834290:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.834798:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.834901:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.834911:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000420653d6/0x50a9699713c4cff1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.834925:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.834929:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.834935:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000420653d6/0x50a9699713c4cff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.834946:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000420653d6/0x50a9699713c4cff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.834954:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000420653d6/0x50a9699713c4cff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.834979:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000420653d6/0x50a9699713c4cff1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.835003:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138103.835812:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.835824:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000420653d6/0x50a9699713c4cff1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.835844:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8000 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.835849:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000420653d6/0x50a9699713c4cff1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.835859:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000420653d6/0x50a9699713c4cff1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.835878:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000420653d6/0x50a9699713c4cff1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.835886:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000420653d6/0x50a9699713c4cff1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.835915:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.835917:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.835918:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.836475:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.836485:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4cff8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.836616:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.836620:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.836629:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4cff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.836645:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4cff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.836739:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4cff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.836747:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4cff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.836782:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.837120:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.837128:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4cff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.837137:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f478c00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.837142:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4cff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.837153:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4cff8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.837170:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4cff8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.837178:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4cff8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.837209:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.837211:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.837213:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.837851:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.837860:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cfff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.837873:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.837877:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.837884:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cfff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.837897:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cfff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.837905:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cfff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.837913:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cfff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.839330:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783138103.839685:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.839700:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4d006 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.839719:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.839733:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.839741:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4d006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.839774:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4d006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.839785:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4d006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.839794:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4d006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783138103.842858:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.842889:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3db995b/0x50a9699713c4d00d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.842910:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.842915:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.842923:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3db995b/0x50a9699713c4d00d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.842940:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3db995b/0x50a9699713c4d00d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.842951:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3db995b/0x50a9699713c4d00d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.842960:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3db995b/0x50a9699713c4d00d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843260:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783138103.843270:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cfff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843280:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479600 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.843285:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cfff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843295:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cfff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843352:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cfff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843361:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014b694b6/0x50a9699713c4cfff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843386:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138103.843390:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4d006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843397:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9800 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.843400:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4d006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843407:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4d006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843417:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4d006 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843424:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.843427:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3db995b/0x50a9699713c4d00d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843432:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8200 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.843442:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3db995b/0x50a9699713c4d00d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843449:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3db995b/0x50a9699713c4d00d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843457:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3db995b/0x50a9699713c4d00d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.843465:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.843466:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.843468:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.848505:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783138103.848521:0:24746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7079fc8/0x50a9699713c4d006 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.848703:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.849294:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783138103.849307:0:24248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3db995b/0x50a9699713c4d00d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783138103.849920:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.849930:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d014 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.849947:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.849954:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.849970:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d014 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.849988:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d014 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.850000:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d014 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.850009:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d014 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783138103.851647:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.851664:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d01b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.851681:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.851685:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.851692:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d01b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.851710:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d01b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.851736:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d01b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.851745:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d01b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.851823:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138103.851838:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d014 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.851850:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8400 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138103.851865:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d014 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.851877:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d014 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.851902:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d014 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.851911:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138103.851916:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d01b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.851924:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9c00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138103.851927:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d01b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.851935:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d01b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.851945:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d01b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.851952:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.851954:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.851957:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.859272:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783138103.859291:0:24248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d014 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783138103.860806:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.860825:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4d022 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.860848:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.860854:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.860862:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4d022 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.860881:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4d022 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.860906:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4d022 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.860914:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4d022 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.864159:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138103.864178:0:24746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d01b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.864431:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138103.864439:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4d022 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.864448:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.864453:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4d022 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.864466:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4d022 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.864488:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4d022 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.864498:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.864518:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.864520:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.868259:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.869257:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.869274:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4d029 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.869298:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.869304:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.869337:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4d029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.869356:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4d029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.869368:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4d029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.869378:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4d029 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.869402:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138103.870039:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.870051:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b694b6/0x50a9699713c4d030 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.870065:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.870069:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.870181:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.870198:0:24248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae679a11/0x50a9699713c4d022 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.870235:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.870243:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4d029 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.870251:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.870258:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4d029 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.870268:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4d029 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.870290:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4d029 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.870298:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc7ef7f/0x50a9699713c4d029 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.870351:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.870353:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.870355:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.870580:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014b694b6/0x50a9699713c4d030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.870607:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014b694b6/0x50a9699713c4d030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.870617:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b694b6/0x50a9699713c4d030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.870625:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014b694b6/0x50a9699713c4d030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.870644:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138103.871019:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.871026:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4d037 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.871039:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.871043:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.871049:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4d037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.871058:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4d037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.871067:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4d037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.871137:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4d037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.871147:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783138103.871413:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.871419:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4d03e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.871428:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.871432:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.871436:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4d03e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.871445:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4d03e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.871453:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4d03e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.871460:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4d03e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.871469:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783138103.872599:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783138103.872612:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014b694b6/0x50a9699713c4d030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.872627:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479600 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.872633:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b694b6/0x50a9699713c4d030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.872645:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b694b6/0x50a9699713c4d030 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.872672:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138103.872847:0:25130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138103.872858:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4d037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.872873:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f478c00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.872877:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4d037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.872889:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4d037 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.872912:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4d037 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.872920:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fa20dbf/0x50a9699713c4d037 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.872941:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.872943:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.872945:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.873140:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.873150:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4d045 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.873171:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.873175:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.873181:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4d045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.873205:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4d045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.873215:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4d045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.873223:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4d045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.873243:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783138103.874139:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138103.874150:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4d045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.874160:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479800 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.874178:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4d045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.874189:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4d045 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.874218:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4d045 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.874227:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000755c4868/0x50a9699713c4d045 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.874374:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.874377:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.874379:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783138103.874873:0:25129:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783138103.875141:0:25129:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783138103.875575:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014b694b6/0x50a9699713c4d030 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.875591:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014b694b6/0x50a9699713c4d030 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.875616:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.875618:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.875621:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783138103.876280:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783138103.876292:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d04c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.876354:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=765s v=(0 0) 00010000:00010000:1.0:1783138103.876360:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138103.876370:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d04c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.876386:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d04c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.876398:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d04c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.876408:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d04c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.876441:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138103.877043:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.877053:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4d053 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877064:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.877067:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.877072:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4d053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877097:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4d053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877118:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4d053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877125:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4d053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877140:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783138103.877369:0:25131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783138103.877376:0:25131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d04c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877385:0:25131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8400 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138103.877391:0:25131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d04c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.877398:0:25130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4d03e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877404:0:25131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d04c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.877449:0:25130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f478000 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.877457:0:25130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4d03e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877460:0:25131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d04c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.877497:0:25130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4d03e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877513:0:25131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2420f56/0x50a9699713c4d04c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.877534:0:25130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4d03e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877542:0:25131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138103.877554:0:25131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4d053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877562:0:25131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f478e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:2.0:1783138103.877571:0:25131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4d053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.877586:0:25130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046f5521a/0x50a9699713c4d03e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877590:0:25131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4d053 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877640:0:25131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4d053 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.877652:0:25131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058130e05/0x50a9699713c4d053 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.877657:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.877664:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.877669:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.877679:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.877683:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138103.877685:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.878104:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.878362:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.878553:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.878564:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba18bb1/0x50a9699713c4d05a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.878579:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=765s v=(0 0) 00002000:00010000:3.0:1783138103.878580:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.878584:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.878596:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba18bb1/0x50a9699713c4d05a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.878597:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d061 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.878640:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.878655:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.878662:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.878682:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba18bb1/0x50a9699713c4d05a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.878685:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.878720:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba18bb1/0x50a9699713c4d05a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.878723:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.878757:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eba18bb1/0x50a9699713c4d05a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.878762:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.879079:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783138103.879147:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783138103.879826:0:25130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138103.879837:0:25130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eba18bb1/0x50a9699713c4d05a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.879849:0:25130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f421dec00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.879856:0:25130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba18bb1/0x50a9699713c4d05a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.879866:0:25130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba18bb1/0x50a9699713c4d05a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.879886:0:25130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eba18bb1/0x50a9699713c4d05a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.879908:0:25130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba18bb1/0x50a9699713c4d05a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.879938:0:25130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.879943:0:25130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.879950:0:25130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9c00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.879953:0:25130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.879961:0:25130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d061 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.879972:0:25130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d061 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.879979:0:25130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b317efd0/0x50a9699713c4d061 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.879994:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.879996:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.879998:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.880188:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.880205:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc4606b/0x50a9699713c4d068 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.880219:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.880223:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.880230:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dc4606b/0x50a9699713c4d068 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.880241:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dc4606b/0x50a9699713c4d068 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.880251:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc4606b/0x50a9699713c4d068 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.880271:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dc4606b/0x50a9699713c4d068 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.880296:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.880733:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.880741:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dc4606b/0x50a9699713c4d068 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.880750:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f421de200 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.880755:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc4606b/0x50a9699713c4d068 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.880763:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc4606b/0x50a9699713c4d068 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.880783:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dc4606b/0x50a9699713c4d068 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.880790:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dc4606b/0x50a9699713c4d068 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.880807:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.880810:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.880811:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.881463:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783138103.882151:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783138103.882166:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ad4262/0x50a9699713c4d06f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.882200:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=765s v=(0 0) 00010000:00010000:0.0:1783138103.882205:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138103.882212:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ad4262/0x50a9699713c4d06f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.882228:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5ad4262/0x50a9699713c4d06f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.882239:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ad4262/0x50a9699713c4d06f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.882247:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ad4262/0x50a9699713c4d06f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.882272:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783138103.882592:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.882600:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faba0c6f/0x50a9699713c4d076 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.882611:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.882614:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.882618:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faba0c6f/0x50a9699713c4d076 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.882629:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faba0c6f/0x50a9699713c4d076 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.882637:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faba0c6f/0x50a9699713c4d076 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.882645:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faba0c6f/0x50a9699713c4d076 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.883046:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783138103.883875:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138103.883892:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5ad4262/0x50a9699713c4d06f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.883909:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028fec00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.883915:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ad4262/0x50a9699713c4d06f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.883928:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ad4262/0x50a9699713c4d06f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.883953:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5ad4262/0x50a9699713c4d06f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.883961:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5ad4262/0x50a9699713c4d06f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.884400:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138103.884407:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faba0c6f/0x50a9699713c4d076 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.884416:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f421dea00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.884420:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faba0c6f/0x50a9699713c4d076 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.884429:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faba0c6f/0x50a9699713c4d076 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.884461:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faba0c6f/0x50a9699713c4d076 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.884468:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faba0c6f/0x50a9699713c4d076 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.884492:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.884494:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.884496:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783138103.885342:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783138103.885359:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075cf832e/0x50a9699713c4d07d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.885392:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1783138103.885396:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138103.885404:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075cf832e/0x50a9699713c4d07d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.885421:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075cf832e/0x50a9699713c4d07d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.885431:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075cf832e/0x50a9699713c4d07d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.885440:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075cf832e/0x50a9699713c4d07d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138103.885477:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783138103.885622:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783138103.885631:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075cf832e/0x50a9699713c4d07d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.885640:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f421de000 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:1.0:1783138103.885646:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075cf832e/0x50a9699713c4d07d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.885665:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075cf832e/0x50a9699713c4d07d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.885687:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075cf832e/0x50a9699713c4d07d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.885694:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075cf832e/0x50a9699713c4d07d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138103.885735:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.885737:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783138103.885738:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783138103.889310:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.889372:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7079fc8/0x50a9699713c4d084 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889390:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.889394:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.889402:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7079fc8/0x50a9699713c4d084 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889416:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7079fc8/0x50a9699713c4d084 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889427:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7079fc8/0x50a9699713c4d084 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889436:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7079fc8/0x50a9699713c4d084 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889467:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783138103.889726:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.889734:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007648d350/0x50a9699713c4d08b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889745:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.889750:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.889755:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007648d350/0x50a9699713c4d08b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889766:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007648d350/0x50a9699713c4d08b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889775:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007648d350/0x50a9699713c4d08b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889784:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007648d350/0x50a9699713c4d08b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889804:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783138103.889817:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783138103.889824:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7079fc8/0x50a9699713c4d084 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889832:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9800 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.889842:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7079fc8/0x50a9699713c4d084 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889852:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7079fc8/0x50a9699713c4d084 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889869:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7079fc8/0x50a9699713c4d084 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889877:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7079fc8/0x50a9699713c4d084 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889896:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783138103.889899:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007648d350/0x50a9699713c4d08b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889905:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9600 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138103.889908:0:22731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007648d350/0x50a9699713c4d08b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889916:0:22731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007648d350/0x50a9699713c4d08b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889924:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007648d350/0x50a9699713c4d08b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889930:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007648d350/0x50a9699713c4d08b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.889945:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.889947:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.889949:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138103.889955:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783138103.890308:0:24746:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00002000:00010000:3.0:1783138103.890396:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783138103.890405:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f624515/0x50a9699713c4d092 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.890414:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1783138103.890417:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138103.890422:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f624515/0x50a9699713c4d092 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.890436:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f624515/0x50a9699713c4d092 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138103.890445:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f624515/0x50a9699713c4d092 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138103.890455:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22767:x1869755175936128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 144599us (145766us total) trans 0 rc 0/0 00010000:00010000:3.0:1783138103.890459:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f624515/0x50a9699713c4d092 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138103.890483:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1783138103.890492:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1783138103.890524:0:24248:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1783138103.890626:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22769:x1869755175935872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 141563us (145313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138103.890647:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783138103.890683:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783138103.890694:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23487:x1869755175936384:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1783138103.890891:0:22767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22767:1869755175936128:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783138103.890914:0:22767:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1783138103.890967:0:22767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22767:1869755175936512:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783138103.891009:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138103.891037:0:22767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f093370c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138103.891054:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175936512 00000100:00100000:2.0:1783138103.891061:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175936512 00000100:00100000:0.0:1783138103.891257:0:22769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22769:1869755175935872:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783138103.891268:0:22769:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1783138103.891296:0:22769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22769:1869755175936640:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783138103.891346:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138103.891365:0:22769:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f10f1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138103.891387:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175936640 00000100:00100000:0.0:1783138103.891390:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175936640 00000100:00100000:0.0:1783138103.891430:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783138103.891438:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22769:x1869755175936640:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783138103.891482:0:24249:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:0.0:1783138103.891665:0:25130:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138103.891674:0:25130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f624515/0x50a9699713c4d092 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.891688:0:25130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9000 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138103.891693:0:25130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f624515/0x50a9699713c4d092 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.891706:0:25130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f624515/0x50a9699713c4d092 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.891732:0:25130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f624515/0x50a9699713c4d092 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138103.891740:0:25130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f624515/0x50a9699713c4d092 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783138103.895261:0:24248:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1783138103.895274:0:24248:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1783138103.895416:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23487:x1869755175936384:12345-0@lo:7:osp-pre-1-1.0 Request processed in 4718us (148606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138103.895427:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783138103.895496:0:23487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23487:1869755175936384:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1783138103.895511:0:23487:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1783138103.895560:0:23487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23487:1869755175936768:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783138103.895606:0:23487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138103.895637:0:23487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2b0bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1783138103.895659:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175936768 00000100:00100000:3.0:1783138103.895666:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175936768 00000100:00100000:3.0:1783138103.895709:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783138103.895721:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23487:x1869755175936768:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783138103.895754:0:24248:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1783138103.895800:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23487:x1869755175936768:12345-0@lo:5:osp-pre-1-1.0 Request processed in 84us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138103.895808:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783138103.895837:0:23487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23487:1869755175936768:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1783138103.895845:0:23487:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1783138103.895868:0:23487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23487:1869755175936896:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783138103.895907:0:23487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138103.895917:0:23487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2b0bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1783138103.895928:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175936896 00000100:00100000:3.0:1783138103.895932:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175936896 00000100:00100000:3.0:1783138103.895948:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783138103.895953:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23487:x1869755175936896:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783138103.895979:0:24248:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:1.0:1783138103.896582:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.900252:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.900260:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138103.900263:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783138103.903130:0:25064:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1783138103.903300:0:25064:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1783138103.903305:0:25064:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783138103.905958:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22769:x1869755175936640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14508us (14599us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1783138103.905976:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783138103.906025:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783138103.906040:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22767:x1869755175936512:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783138103.906113:0:24249:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000100:00100000:2.0:1783138103.908793:0:22769:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1783138103.908816:0:22769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22769:1869755175936640:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783138103.908851:0:22769:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000001:00080000:1.0:1783138103.930896:0:24245:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1783138103.930978:0:24245:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783138103.930983:0:24245:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000100:00100000:0.0:1783138103.932256:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22767:x1869755175936512:12345-0@lo:5:osp-pre-0-0.0 Request processed in 26210us (41234us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1783138103.932273:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783138103.932460:0:22767:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1783138103.932472:0:22767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22767:1869755175936512:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783138103.935434:0:22767:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:2.0:1783138103.951926:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23487:x1869755175936896:12345-0@lo:5:osp-pre-1-1.0 Request processed in 55965us (56010us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1783138103.951942:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783138103.952024:0:23487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23487:1869755175936896:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1783138103.952053:0:23487:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1783138103.952619:0:23487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23487:1869755175937024:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1783138103.952845:0:23487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138103.952890:0:23487:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f10f1e300 going to sleep for 11 seconds 00000100:00100000:1.0:1783138103.953176:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175937024 00000100:00100000:1.0:1783138103.953185:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175937024 00000100:00100000:1.0:1783138103.953267:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783138103.953278:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23487:x1869755175937024:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1783138103.953804:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23487:x1869755175937024:12345-0@lo:900:osp-pre-1-1.0 Request processed in 523us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138103.953816:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783138103.954215:0:23487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f3f48d180 x1869755175937024/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783138119 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138103.954232:0:23487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23487:1869755175937024:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1783138104.121582:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783138104.122249:0:22739:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783138104.122259:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9e3e038cb000 from 14 10000000:01000000:2.0:1783138104.122267:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783138104.122350:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f421de600/0x50a9699713c4d099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138104.122362:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f421de600/0x50a9699713c4d099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138104.122373:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f421de600/0x50a9699713c4d099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138104.122402:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175937152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783138104.122476:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138104.122546:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f09337600 going to sleep for 11 seconds 00000100:00100000:1.0:1783138104.122549:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175937152 00000100:00100000:1.0:1783138104.122576:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175937152 00000100:00100000:1.0:1783138104.122657:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783138104.122671:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+22:22739:x1869755175937152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138104.122691:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138104.122713:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e041f8c00/0x50a9699713c4d0a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4d099 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138104.122744:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e041f8c00/0x50a9699713c4d0a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4d099 expref: 23 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138104.122757:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e041f8c00/0x50a9699713c4d0a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4d099 expref: 23 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138104.122769:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e041f8c00, rc 0) 00000100:00100000:1.0:1783138104.122862:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+23:22739:x1869755175937152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138104.122869:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783138104.123036:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175937152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138104.123060:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f421de600/0x50a9699713c4d099 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d0a0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138104.123070:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f421de600/0x50a9699713c4d099 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4d0a0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138104.123138:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175937280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783138104.123181:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138104.124255:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f09337600 going to sleep for 11 seconds 00000100:00100000:2.0:1783138104.124405:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175937280 00000100:00100000:2.0:1783138104.124414:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175937280 00000100:00100000:2.0:1783138104.124461:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783138104.124473:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+23:22739:x1869755175937280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783138104.124497:0:22735:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783138104.124517:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783138104.124520:0:22735:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1783138104.124632:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+23:22739:x1869755175937280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138104.124640:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783138104.124694:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175937280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783138104.124764:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783138104.124773:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f421de600/0x50a9699713c4d099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d0a0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138104.124782:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f421de600/0x50a9699713c4d099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d0a0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138104.124791:0:22739:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783138104.124794:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9e3f3625b800 from 14 10000000:01000000:2.0:1783138104.124797:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783138104.124826:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f421de800/0x50a9699713c4d0a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138104.124834:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f421de800/0x50a9699713c4d0a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138104.124842:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f421de800/0x50a9699713c4d0a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138104.124869:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175937408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783138104.124907:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138104.124926:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f09337600 going to sleep for 11 seconds 00000100:00100000:2.0:1783138104.124940:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175937408 00000100:00100000:2.0:1783138104.124944:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175937408 00000100:00100000:2.0:1783138104.124969:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783138104.124979:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+23:22739:x1869755175937408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138104.124988:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138104.125003:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f421df200/0x50a9699713c4d0ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4d0a7 expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138104.125025:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f421df200/0x50a9699713c4d0ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4d0a7 expref: 24 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138104.125037:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f421df200/0x50a9699713c4d0ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4d0a7 expref: 24 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138104.125046:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f421df200, rc 0) 00000100:00100000:2.0:1783138104.125077:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:22739:x1869755175937408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138104.125083:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783138104.125112:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175937408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138104.125122:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f421de800/0x50a9699713c4d0a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d0ae expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138104.125132:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f421de800/0x50a9699713c4d0a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4d0ae expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138104.125182:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175937536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783138104.125230:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138104.125249:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f09337600 going to sleep for 11 seconds 00000100:00100000:2.0:1783138104.125262:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175937536 00000100:00100000:2.0:1783138104.125264:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175937536 00000100:00100000:2.0:1783138104.125291:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783138104.125297:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:22739:x1869755175937536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783138104.125309:0:22737:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783138104.125353:0:22737:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783138104.125356:0:22737:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1783138104.125419:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:22739:x1869755175937536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138104.125426:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783138104.125461:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175937536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783138104.125501:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783138104.125506:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f421de800/0x50a9699713c4d0a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d0ae expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138104.125514:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f421de800/0x50a9699713c4d0a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d0ae expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138105.145423:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138106.174491:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138107.198042:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138107.270366:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783138107.270389:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175937664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783138107.270457:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138107.270510:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175937664 00000100:00100000:3.0:1783138107.270518:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175937664 00000100:00100000:3.0:1783138107.270582:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783138107.270593:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175937664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783138107.270624:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783138107.270670:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175937664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138107.270678:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1783138107.270699:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783138107.270732:0:3661:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1783138107.270755:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175937664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783138107.773627:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175937792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138107.773702:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138107.773770:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175937792 00000100:00100000:1.0:1783138107.773778:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175937792 00000100:00100000:1.0:1783138107.773826:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783138107.773835:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175937792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783138107.773869:0:23767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783138107.773914:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175937792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138107.773921:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783138107.773977:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175937792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138107.776415:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783138107.778225:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175937920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783138107.778301:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138107.778734:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175937920 00000100:00100000:3.0:1783138107.778743:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175937920 00000100:00100000:3.0:1783138107.778797:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783138107.778807:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175937920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783138107.778863:0:22748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783138107.778958:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175937920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138107.778965:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783138107.782006:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175937920:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783138108.218436:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138108.793854:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783138108.793878:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175938048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783138108.793950:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138108.794042:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175938048 00000100:00100000:3.0:1783138108.794050:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175938048 00000100:00100000:3.0:1783138108.794101:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783138108.794110:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175938048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783138108.794139:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783138108.794204:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175938048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138108.794210:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1783138108.794229:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783138108.795362:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175938048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783138108.797662:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869755175938560:0@lo:400:kworker.0 00000100:00100000:3.0:1783138108.797726:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138108.797755:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175938560 00000100:00100000:3.0:1783138108.797762:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869755175939072:0@lo:400:kworker.0 00000100:00100000:2.0:1783138108.797763:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175938560 00000100:00100000:3.0:1783138108.797783:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138108.797798:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869755175939584:0@lo:400:kworker.0 00000100:00100000:2.0:1783138108.797807:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175939072 00000100:00100000:2.0:1783138108.797810:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175939072 00000100:00100000:3.0:1783138108.797822:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138108.797824:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175939584 00000100:00100000:3.0:1783138108.797834:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783138108.797839:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175938432:0@lo:400:kworker.0 00000100:00100000:2.0:1783138108.797840:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175939584 00000100:00100000:3.0:1783138108.797860:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138108.797866:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783138108.797874:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175938944:0@lo:400:kworker.0 00000100:00100000:2.0:1783138108.797875:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0ac9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869755175938560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138108.797891:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138108.797905:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869755175939456:0@lo:400:kworker.0 00000100:00100000:2.0:1783138108.797919:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0ac9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1869755175938560:12345-0@lo:400:kworker.0 Request processed in 46us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138108.797926:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783138108.797931:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138108.797938:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175939456 00000100:00100000:2.0:1783138108.797941:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175939456 00010000:00080000:3.0:1783138108.797952:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e0287df80 x1869755175938560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138108.797954:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783138108.797958:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869755175939072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138108.797965:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1869755175938560:0@lo:400:kworker.0 00000100:00100000:2.0:1783138108.797982:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1869755175939072:12345-0@lo:400:kworker.0 Request processed in 23us (198us total) trans 0 rc 0/0 00010000:00080000:3.0:1783138108.797985:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e0287d880 x1869755175939072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138108.797987:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783138108.797994:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1869755175939072:0@lo:400:kworker.0 00000100:00100000:2.0:1783138108.797997:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783138108.798002:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869755175939584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138108.798011:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175938432 00000100:00100000:3.0:1783138108.798014:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175938432 00000100:00100000:2.0:1783138108.798030:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1869755175939584:12345-0@lo:400:kworker.0 Request processed in 28us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138108.798035:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783138108.798038:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175938944 00000100:00100000:3.0:1783138108.798040:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175938944 00000100:00100000:2.0:1783138108.798044:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783138108.798049:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869755175939456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138108.798057:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783138108.798062:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175938432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138108.798072:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869755175939456:12345-0@lo:400:kworker.0 Request processed in 23us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138108.798077:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783138108.798085:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175938432:12345-0@lo:400:kworker.0 Request processed in 24us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138108.798090:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783138108.798100:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783138108.798105:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3659:x1869755175938944:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783138108.798109:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783138108.798112:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783138108.798115:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783138108.798117:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783138108.798127:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3659:x1869755175938944:12345-0@lo:400:kworker.0 Request processed in 23us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138108.798133:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783138108.798138:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175938432:0@lo:400:kworker.0 00000100:00100000:2.0:1783138108.798147:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175938944:0@lo:400:kworker.0 00010000:00080000:2.0:1783138108.798172:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e0287e680 x1869755175939456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138108.798181:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869755175939456:0@lo:400:kworker.0 00010000:00080000:2.0:1783138108.798189:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f0ac9f100 x1869755175939584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138108.798196:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1869755175939584:0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.801303:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175938176:0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.801392:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138108.801437:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175938688:0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.801462:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138108.801480:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175939200:0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.801502:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138108.801520:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175939712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783138108.801543:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138108.801567:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783138108.801574:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175938304:0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.801595:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138108.801612:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175938816:0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.801634:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138108.801651:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869755175939328:0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.801675:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138108.801708:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175938176 00000100:00100000:1.0:1783138108.801716:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175938176 00000100:00100000:1.0:1783138108.801759:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783138108.801766:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+24:3660:x1869755175938176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.801809:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+24:3660:x1869755175938176:12345-0@lo:400:kworker.0 Request processed in 43us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138108.801824:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783138108.801853:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175938688 00000100:00100000:1.0:1783138108.801856:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175938688 00000100:00100000:1.0:1783138108.801876:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175938304 00000100:00100000:1.0:1783138108.801879:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175938304 00000100:00100000:1.0:1783138108.801889:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783138108.801894:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175938688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.801928:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175938688:12345-0@lo:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138108.801933:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783138108.801944:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783138108.801948:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175938304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.801972:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175938304:12345-0@lo:400:kworker.0 Request processed in 23us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138108.801977:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783138108.801992:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175939200 00000100:00100000:1.0:1783138108.801995:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175939200 00000100:00100000:1.0:1783138108.802024:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175939328 00000100:00100000:1.0:1783138108.802027:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175939328 00000100:00100000:1.0:1783138108.802043:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783138108.802049:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175939200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.802075:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175939200:12345-0@lo:400:kworker.0 Request processed in 27us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138108.802081:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783138108.802092:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783138108.802097:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869755175939328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.802130:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1869755175939328:12345-0@lo:400:kworker.0 Request processed in 33us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138108.802136:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783138108.802167:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175938816 00000100:00100000:1.0:1783138108.802171:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175938816 00000100:00100000:1.0:1783138108.802193:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783138108.802198:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175938816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.802224:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175938816:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138108.802230:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1783138108.802253:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783138108.802257:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783138108.802277:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175939712 00000100:00100000:1.0:1783138108.802280:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175939712 00000100:00100000:1.0:1783138108.802302:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138108.802307:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175939712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783138108.802338:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783138108.802382:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175939712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138108.802388:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783138108.802422:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175938304:0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.802433:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175938816:0@lo:400:kworker.0 00010000:00080000:1.0:1783138108.802444:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e0287f100 x1869755175939328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138108.802454:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1869755175939328:0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.802472:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175938176:0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.802482:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175938688:0@lo:400:kworker.0 00010000:00080000:1.0:1783138108.802491:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e0287ed80 x1869755175939200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783138108.802498:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175939200:0@lo:400:kworker.0 00000100:00100000:1.0:1783138108.802512:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175939712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783138108.802686:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783138108.802696:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175939840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783138108.802730:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138108.803201:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175939840 00000100:00100000:0.0:1783138108.803207:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175939840 00000100:00100000:0.0:1783138108.803245:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138108.803252:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3660:x1869755175939840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783138108.803265:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783138108.803308:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3660:x1869755175939840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138108.803345:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783138108.803381:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175939840:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1783138109.219123:0:25421:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783138109.241433:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783138109.321708:0:25064:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000040:00080000:0.0:1783138109.562465:0:22776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1783138110.183212:0:25473:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783138110.183751:0:25473:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783138110.267256:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783138111.071339:0:25523:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783138111.071629:0:25523:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783138111.290899:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783138111.348952:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.349077:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157989504 00000100:00100000:2.0:1783138111.349088:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157989504 00000100:00100000:2.0:1783138111.349134:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:2.0:1783138111.349152:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2c42a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2399:x1869755157989504:12345-192.168.203.43@tcp:250:mount.lustre.0 00010000:00080000:2.0:1783138111.349182:0:22736:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 0e64806b-c006-4a0c-9437-03f90192be80@192.168.203.43@tcp t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:2.0:1783138111.349214:0:22736:0:(genops.c:1406:class_connect()) connect: client 0e64806b-c006-4a0c-9437-03f90192be80, cookie 0x50a9699713c4d0b5 00000100:00080000:2.0:1783138111.349399:0:22736:0:(import.c:65:import_set_state_nolock()) ffff9e3e02aa3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138111.349474:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2c42a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+5:2399:x1869755157989504:12345-192.168.203.43@tcp:250:mount.lustre.0 Request processed in 321us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.349482:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:3.0:1783138111.367431:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138111.367585:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157989632 00000100:00100000:1.0:1783138111.367596:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157989632 00000100:00100000:1.0:1783138111.367656:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:1.0:1783138111.367675:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2c42a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+5:18091:x1869755157989632:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783138111.367693:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138111.367712:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e041f8800/0x50a9699713c4d0bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x40dea3941757a6d4 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138111.367738:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e041f8800/0x50a9699713c4d0bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a6d4 expref: 6 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138111.367748:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e041f8800/0x50a9699713c4d0bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a6d4 expref: 6 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138111.367757:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e041f8800, rc 0) 00000100:00100000:1.0:1783138111.367813:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2c42a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+6:18091:x1869755157989632:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 139us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138111.367837:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:0.0:1783138111.374447:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.374683:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157989760 00000100:00100000:2.0:1783138111.374757:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157989760 00000100:00100000:2.0:1783138111.374813:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:2.0:1783138111.374822:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2c429c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+6:18091:x1869755157989760:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783138111.374935:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2c429c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+6:18091:x1869755157989760:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 114us (499us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783138111.374958:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:3.0:1783138111.382238:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.382600:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157989888 00000100:00100000:2.0:1783138111.382611:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157989888 00000100:00100000:2.0:1783138111.382682:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:2.0:1783138111.382765:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+6:18091:x1869755157989888:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783138111.382783:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138111.382802:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f421de000/0x50a9699713c4d0c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x40dea3941757a6db expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.382829:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f421de000/0x50a9699713c4d0c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a6db expref: 7 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.382841:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f421de000/0x50a9699713c4d0c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a6db expref: 7 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.382851:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f421de000, rc 0) 00000100:00100000:2.0:1783138111.382918:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+7:18091:x1869755157989888:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 228us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.382926:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:3.0:1783138111.394027:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138111.394192:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157990016 00000100:00100000:1.0:1783138111.394203:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157990016 00000100:00100000:1.0:1783138111.394260:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:1.0:1783138111.394270:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+7:18091:x1869755157990016:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783138111.394453:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+8:18091:x1869755157990016:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 183us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138111.394460:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:3.0:1783138111.397121:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138111.397216:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157990144 00000100:00100000:0.0:1783138111.397225:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157990144 00000100:00100000:0.0:1783138111.397275:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:0.0:1783138111.397286:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+8:18091:x1869755157990144:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783138111.397478:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+8:18091:x1869755157990144:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 192us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138111.397487:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:3.0:1783138111.408448:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.411848:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157990272 00000100:00100000:2.0:1783138111.411862:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157990272 00000100:00100000:2.0:1783138111.411936:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:2.0:1783138111.411947:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+8:18110:x1869755157990272:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138111.412112:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+8:18110:x1869755157990272:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 166us (3672us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.412119:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:1.0:1783138111.459556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.459854:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157990400 00000100:00100000:2.0:1783138111.459865:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157990400 00000100:00100000:2.0:1783138111.459925:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:2.0:1783138111.459934:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+8:18110:x1869755157990400:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138111.460080:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+8:18110:x1869755157990400:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 146us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.460088:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:0.0:1783138111.474692:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.474911:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157990528 00000100:00100000:2.0:1783138111.474932:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157990528 00000100:00100000:2.0:1783138111.474999:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:2.0:1783138111.475009:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+8:18110:x1869755157990528:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138111.475176:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+8:18110:x1869755157990528:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 168us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.475185:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:1.0:1783138111.481287:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.481366:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157990656 00000100:00100000:2.0:1783138111.481379:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157990656 00000100:00100000:2.0:1783138111.481437:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:2.0:1783138111.481447:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+8:18091:x1869755157990656:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783138111.481464:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138111.481484:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f421df800/0x50a9699713c4d0ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x40dea3941757a70c expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.481511:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f421df800/0x50a9699713c4d0ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a70c expref: 9 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.481523:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f421df800/0x50a9699713c4d0ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a70c expref: 9 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.481709:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f421df800, rc 0) 00000100:00100000:2.0:1783138111.481805:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+9:18091:x1869755157990656:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 358us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.481812:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:2.0:1783138111.485214:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138111.485409:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157990784 00000100:00100000:0.0:1783138111.485418:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157990784 00000100:00100000:0.0:1783138111.485473:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:0.0:1783138111.485482:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+9:18091:x1869755157990784:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783138111.485507:0:22736:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783138111.485532:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783138111.485546:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783138111.485551:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783138111.485554:0:22736:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783138111.485556:0:22736:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1783138111.487376:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+9:18091:x1869755157990784:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 1884us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.487391:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:1.0:1783138111.490686:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138111.490874:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157990912 00000100:00100000:3.0:1783138111.490886:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157990912 00000100:00100000:3.0:1783138111.490940:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:3.0:1783138111.490951:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+9:18091:x1869755157990912:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783138111.490968:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138111.490985:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e028b9600/0x50a9699713c4d0d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x40dea3941757a713 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138111.491034:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028b9600/0x50a9699713c4d0d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a713 expref: 10 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138111.491045:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e028b9600/0x50a9699713c4d0d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a713 expref: 10 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138111.491055:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b9600, rc 0) 00000100:00100000:3.0:1783138111.491108:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+10:18091:x1869755157990912:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 160us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138111.491115:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:3.0:1783138111.493162:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138111.493307:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157991040 00000100:00100000:0.0:1783138111.493360:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157991040 00000100:00100000:0.0:1783138111.493410:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:0.0:1783138111.493421:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0285c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+10:18091:x1869755157991040:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783138111.493563:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0285c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+10:18091:x1869755157991040:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 143us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138111.493570:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:0.0:1783138111.496131:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138111.496549:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157991168 00000100:00100000:1.0:1783138111.496559:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157991168 00000100:00100000:1.0:1783138111.496616:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:1.0:1783138111.496638:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0285f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+10:18091:x1869755157991168:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783138111.496948:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0285f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+10:18091:x1869755157991168:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 322us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138111.496956:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:1.0:1783138111.502644:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.503349:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157991296 00000100:00100000:2.0:1783138111.503360:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157991296 00000100:00100000:2.0:1783138111.503423:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:2.0:1783138111.503434:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0285dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+10:18116:x1869755157991296:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138111.503602:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0285dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+10:18116:x1869755157991296:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 169us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.503611:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:3.0:1783138111.510860:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138111.511016:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157991424 00000100:00100000:1.0:1783138111.511031:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157991424 00000100:00100000:1.0:1783138111.511086:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:1.0:1783138111.511096:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f03ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+10:18116:x1869755157991424:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783138111.511263:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f03ad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+10:18116:x1869755157991424:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 167us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138111.511280:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:0.0:1783138111.518892:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138111.518991:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.519260:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157991552 00000100:00100000:2.0:1783138111.519274:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157991552 00000100:00100000:2.0:1783138111.519358:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157991808 00000100:00100000:2.0:1783138111.519362:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157991808 00000100:00100000:2.0:1783138111.519389:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1783138111.519397:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1869755157991552:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783138111.519425:0:22742:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 10dbad77-f39f-415a-b3e7-d386fe5df21f@192.168.203.43@tcp t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:2.0:1783138111.519473:0:22742:0:(genops.c:1406:class_connect()) connect: client 10dbad77-f39f-415a-b3e7-d386fe5df21f, cookie 0x50a9699713c4d0d8 00000004:00100000:2.0:1783138111.519499:0:22742:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783138111.519731:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9e3e02aa7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138111.519808:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2399:x1869755157991552:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 410us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.519815:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1783138111.519833:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1783138111.519837:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1869755157991808:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783138111.519851:0:22742:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 10dbad77-f39f-415a-b3e7-d386fe5df21f@192.168.203.43@tcp t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:2.0:1783138111.519882:0:22742:0:(genops.c:1406:class_connect()) connect: client 10dbad77-f39f-415a-b3e7-d386fe5df21f, cookie 0x50a9699713c4d0df 00000004:00100000:2.0:1783138111.519895:0:22742:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783138111.520068:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9e3f3564f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138111.520094:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2399:x1869755157991808:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 256us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.520102:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1783138111.526982:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.527534:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157991936 00000100:00100000:2.0:1783138111.527544:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157991936 00000100:00100000:2.0:1783138111.527613:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1783138111.527623:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e04332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:0:x1869755157991936:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783138111.527663:0:22742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1783138111.527779:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783138111.534244:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e04332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:0:x1869755157991936:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 6607us (7256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.534263:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1783138111.535356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138111.535489:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138111.536050:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157992064 00000100:00100000:3.0:1783138111.536061:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157992064 00000100:00100000:3.0:1783138111.536121:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157991680 00000100:00100000:3.0:1783138111.536125:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157991680 00000100:00100000:3.0:1783138111.536156:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1783138111.536166:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:18091:x1869755157992064:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783138111.536204:0:22744:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783138111.536285:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:18091:x1869755157992064:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 121us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138111.536293:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1783138111.536332:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1783138111.536341:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:0:x1869755157991680:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783138111.536353:0:22744:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783138111.536375:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:0:x1869755157991680:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 36us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138111.536382:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00080000:1.0:1783138111.537524:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783138111.542518:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138111.545553:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157992192 00000100:00100000:3.0:1783138111.545567:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157992192 00000100:00100000:2.0:1783138111.546553:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1783138111.546566:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18091:x1869755157992192:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783138111.546971:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18091:x1869755157992192:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 406us (4461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.546996:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1783138111.556880:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138111.556995:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138111.557162:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.557280:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157992320 00000100:00100000:2.0:1783138111.557291:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157992320 00000100:00100000:2.0:1783138111.557368:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157992448 00000100:00100000:2.0:1783138111.557372:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157992448 00000100:00100000:2.0:1783138111.557392:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1783138111.557400:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1869755157992320:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783138111.557435:0:24250:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 10dbad77-f39f-415a-b3e7-d386fe5df21f@192.168.203.43@tcp t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:2.0:1783138111.557464:0:24250:0:(genops.c:1406:class_connect()) connect: client 10dbad77-f39f-415a-b3e7-d386fe5df21f, cookie 0x50a9699713c4d0e6 00002000:00100000:2.0:1783138111.557477:0:24250:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10dbad77-f39f-415a-b3e7-d386fe5df21f/ffff9e3f3564e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783138111.557504:0:24250:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783138111.557672:0:24250:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783138111.557700:0:24250:0:(import.c:65:import_set_state_nolock()) ffff9e3f35649800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138111.557758:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2399:x1869755157992320:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 359us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.557778:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1783138111.557796:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1783138111.557800:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1869755157992448:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783138111.557817:0:24250:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 10dbad77-f39f-415a-b3e7-d386fe5df21f@192.168.203.43@tcp t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:2.0:1783138111.557834:0:24250:0:(genops.c:1406:class_connect()) connect: client 10dbad77-f39f-415a-b3e7-d386fe5df21f, cookie 0x50a9699713c4d0ed 00002000:00100000:2.0:1783138111.557839:0:24250:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10dbad77-f39f-415a-b3e7-d386fe5df21f/ffff9e3f3564a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783138111.557851:0:24250:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783138111.561151:0:24250:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783138111.561203:0:24250:0:(import.c:65:import_set_state_nolock()) ffff9e3f3564c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138111.561288:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2399:x1869755157992448:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 3484us (4291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.561299:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1783138111.561366:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157992576 00000100:00100000:1.0:1783138111.561374:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157992576 00000100:00100000:1.0:1783138111.561432:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:1.0:1783138111.561691:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18091:x1869755157992576:12345-192.168.203.43@tcp:900:mount.lustre.0 00000100:00100000:1.0:1783138111.561736:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18091:x1869755157992576:12345-192.168.203.43@tcp:900:mount.lustre.0 Request processed in 296us (4573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138111.561743:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:1.0:1783138111.577165:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.577282:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157992704 00000100:00100000:2.0:1783138111.577293:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157992704 00000100:00100000:2.0:1783138111.577386:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1783138111.577396:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18091:x1869755157992704:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00080000:2.0:1783138111.578654:0:22745:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1179us 00000004:00200000:3.0:1783138111.598043:0:22745:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783138111.598188:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18091:x1869755157992704:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 20788us (21027us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138111.598206:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:1.0:1783138111.790984:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138111.791614:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157992832 00000100:00100000:2.0:1783138111.791625:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157992832 00000100:00100000:2.0:1783138111.791701:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1783138111.791711:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18139:x1869755157992832:12345-192.168.203.43@tcp:101:mkdir.0 00010000:00010000:2.0:1783138111.791733:0:23996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138111.791757:0:23996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f421de200/0x50a9699713c4d0f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a744 expref: -99 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.791824:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f421dec00/0x50a9699713c4d0fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.791837:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f421dec00/0x50a9699713c4d0fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.791851:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f421dec00/0x50a9699713c4d0fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138111.791897:0:23996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783138111.791901:0:23996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783138111.791947:0:23996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f421dec00/0x50a9699713c4d0fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.791973:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f421de200/0x50a9699713c4d0f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a744 expref: 8 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.791994:0:23996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f421dec00/0x50a9699713c4d0fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a744 expref: 7 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138111.792003:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3f3e1c9300) 00010000:00010000:2.0:1783138111.792006:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783138111.792009:0:23996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f421dec00, rc 0) 00000100:00100000:2.0:1783138111.792269:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:18139:x1869755157992832:12345-192.168.203.43@tcp:101:mkdir.0 Request processed in 558us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138111.792277:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00010000:00010000:0.0:1783138112.314458:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138112.378087:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783138112.378108:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175939968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783138112.378191:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138112.379254:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175939968 00000100:00100000:0.0:1783138112.379266:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175939968 00000100:00100000:0.0:1783138112.379393:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138112.379403:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175939968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783138112.379431:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783138112.379509:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175939968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138112.379517:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138112.380461:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175939968:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783138112.380875:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783138112.892079:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783138112.892104:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03a7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175940096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138112.892194:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138112.892286:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175940096 00000100:00100000:1.0:1783138112.892294:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175940096 00000100:00100000:1.0:1783138112.892376:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783138112.892387:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175940096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783138112.892433:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783138112.892483:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175940096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138112.892491:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783138112.892854:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03a7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175940096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138112.893167:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175940224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783138112.893207:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138112.893293:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175940224 00000100:00100000:2.0:1783138112.893298:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175940224 00000100:00100000:2.0:1783138112.893359:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783138112.893376:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175940224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783138112.893400:0:23767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783138112.893443:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175940224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138112.893449:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783138112.893686:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175940224:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783138113.337489:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138113.913756:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175940736:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.913827:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.913860:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175941248:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.913882:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.913896:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f34297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869755175941760:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.913919:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.913941:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1783138113.913947:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175940352:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.913976:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.914000:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175940864:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.914025:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.914038:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175941376:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.914057:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.914070:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f34294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869755175941888:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.914090:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.914114:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175940480:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.914148:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.914165:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175940992:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.914185:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.914197:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f34296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869755175941504:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.914216:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.914226:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783138113.914231:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175940608:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.914250:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.914280:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175941120:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.914302:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.914338:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f34294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869755175941632:0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.914359:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138113.914382:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175940480 00000100:00100000:0.0:1783138113.914389:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175940480 00000100:00100000:0.0:1783138113.914427:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175940992 00000100:00100000:0.0:1783138113.914430:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175940992 00000100:00100000:0.0:1783138113.914447:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783138113.914455:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175940480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138113.914517:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175940480:12345-0@lo:400:kworker.0 Request processed in 62us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138113.914525:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783138113.914871:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175941760 00000100:00100000:3.0:1783138113.914882:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175941760 00000100:00100000:3.0:1783138113.914915:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175940864 00000100:00100000:3.0:1783138113.914918:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175940864 00000100:00100000:3.0:1783138113.914928:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175941376 00000100:00100000:3.0:1783138113.914931:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175941376 00000100:00100000:3.0:1783138113.914939:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175941888 00000100:00100000:3.0:1783138113.914941:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175941888 00000100:00100000:3.0:1783138113.914952:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175941504 00000100:00100000:3.0:1783138113.914955:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175941504 00000100:00100000:3.0:1783138113.914967:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175941632 00000100:00100000:3.0:1783138113.914969:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175941632 00000100:00100000:3.0:1783138113.914983:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783138113.914989:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869755175941760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915034:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869755175941760:12345-0@lo:400:kworker.0 Request processed in 45us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138113.915040:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783138113.915054:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783138113.915060:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175940864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915086:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175940864:12345-0@lo:400:kworker.0 Request processed in 27us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138113.915092:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783138113.915103:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783138113.915109:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175941376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915144:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175941376:12345-0@lo:400:kworker.0 Request processed in 36us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138113.915150:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783138113.915161:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783138113.915166:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869755175941888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915202:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869755175941888:12345-0@lo:400:kworker.0 Request processed in 36us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138113.915208:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783138113.915219:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783138113.915225:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869755175941504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915265:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869755175941504:12345-0@lo:400:kworker.0 Request processed in 40us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138113.915270:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783138113.915281:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783138113.915287:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869755175941632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915333:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869755175941632:12345-0@lo:400:kworker.0 Request processed in 26us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138113.915339:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783138113.915357:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175940352 00000100:00100000:3.0:1783138113.915360:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175940352 00000100:00100000:3.0:1783138113.915382:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783138113.915389:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+24:3660:x1869755175940352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915418:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+24:3660:x1869755175940352:12345-0@lo:400:kworker.0 Request processed in 30us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138113.915424:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783138113.915451:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783138113.915458:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175940992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915497:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175940992:12345-0@lo:400:kworker.0 Request processed in 39us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138113.915502:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783138113.915556:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03b01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175940352:0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915572:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175940864:0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915582:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175941376:0@lo:400:kworker.0 00010000:00080000:3.0:1783138113.915593:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f34294380 x1869755175941888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138113.915604:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f34294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869755175941888:0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915614:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f34297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869755175941760:0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915681:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175942016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783138113.915708:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783138113.915734:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f34294700 x1869755175941632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138113.915743:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f34294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869755175941632:0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915752:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175940480:0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915761:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175940992:0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915772:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f34296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869755175941504:0@lo:400:kworker.0 00000100:00100000:3.0:1783138113.915806:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175942016 00000100:00100000:3.0:1783138113.915810:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175942016 00000100:00100000:3.0:1783138113.915838:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783138113.915844:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175942016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783138113.915866:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783138113.915899:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175942016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138113.915912:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783138113.915938:0:3658:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1783138113.915953:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175942016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783138113.916710:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175942144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138113.916749:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138113.916784:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175942144 00000100:00100000:2.0:1783138113.916796:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175942144 00000100:00100000:2.0:1783138113.916829:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783138113.916836:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175942144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783138113.916850:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1783138113.916883:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175942144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138113.916889:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783138113.916925:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175942144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783138113.916961:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175940736 00000100:00100000:2.0:1783138113.916964:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175940736 00000100:00100000:2.0:1783138113.916980:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175941248 00000100:00100000:2.0:1783138113.916982:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175941248 00000100:00100000:2.0:1783138113.916993:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175940608 00000100:00100000:2.0:1783138113.916996:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175940608 00000100:00100000:2.0:1783138113.917008:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175941120 00000100:00100000:2.0:1783138113.917010:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175941120 00000100:00100000:2.0:1783138113.917022:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783138113.917029:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175940736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138113.917065:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175940736:12345-0@lo:400:kworker.0 Request processed in 36us (3239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138113.917072:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783138113.917083:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138113.917089:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175941248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138113.917125:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175941248:12345-0@lo:400:kworker.0 Request processed in 26us (3232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138113.917130:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783138113.917142:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783138113.917148:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175940608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138113.917189:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175940608:12345-0@lo:400:kworker.0 Request processed in 41us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138113.917196:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783138113.917206:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138113.917212:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175941120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138113.917238:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175941120:12345-0@lo:400:kworker.0 Request processed in 26us (2935us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138113.917243:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783138113.917270:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175940608:0@lo:400:kworker.0 00000100:00100000:2.0:1783138113.917279:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175941120:0@lo:400:kworker.0 00000100:00100000:2.0:1783138113.917306:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175940736:0@lo:400:kworker.0 00000100:00100000:2.0:1783138113.917336:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175941248:0@lo:400:kworker.0 00000100:00080000:1.0:1783138113.917510:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783138113.917515:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783138113.917517:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783138113.917528:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1783138113.918464:0:23496:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783138113.920372:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783138113.920394:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175942272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783138113.920473:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138113.923092:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175942272 00000100:00100000:2.0:1783138113.923106:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175942272 00000100:00100000:2.0:1783138113.923188:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783138113.923199:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175942272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783138113.923232:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783138113.923359:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175942272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138113.923367:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783138113.927486:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175942272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783138113.968748:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138113.968863:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157992960 00000100:00100000:0.0:1783138113.968873:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157992960 00000100:00100000:0.0:1783138113.968955:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1783138113.968966:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:18192:x1869755157992960:12345-192.168.203.43@tcp:41:lfs.0 00000004:00000024:0.0:1783138113.969018:0:22743:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783138113.969111:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:18192:x1869755157992960:12345-192.168.203.43@tcp:41:lfs.0 Request processed in 146us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138113.969129:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00080000:1.0:1783138113.969479:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783138113.971804:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138113.971901:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157993088 00000100:00100000:2.0:1783138113.971911:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157993088 00000100:00100000:2.0:1783138113.971985:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:2.0:1783138113.971994:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18192:x1869755157993088:12345-192.168.203.43@tcp:41:lfs.0 00000004:00000024:2.0:1783138113.972043:0:22744:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783138113.972141:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18192:x1869755157993088:12345-192.168.203.43@tcp:41:lfs.0 Request processed in 148us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138113.972149:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00080000:1.0:1783138113.972723:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783138113.976802:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138113.976898:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157993216 00000100:00100000:2.0:1783138113.976909:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157993216 00000100:00100000:2.0:1783138113.976979:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1783138113.976990:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18192:x1869755157993216:12345-192.168.203.43@tcp:13:lfs.0 00002000:00000024:2.0:1783138113.977015:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783138113.977141:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18192:x1869755157993216:12345-192.168.203.43@tcp:13:lfs.0 Request processed in 152us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138113.977149:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00080000:1.0:1783138113.977795:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783138113.980877:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138113.981726:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157993344 00000100:00100000:2.0:1783138113.981737:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157993344 00000100:00100000:2.0:1783138113.981825:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1783138113.981835:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18192:x1869755157993344:12345-192.168.203.43@tcp:13:lfs.0 00002000:00000024:2.0:1783138113.981860:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1783138113.981958:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18192:x1869755157993344:12345-192.168.203.43@tcp:13:lfs.0 Request processed in 124us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138113.981966:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00080000:1.0:1783138113.982361:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783138114.165520:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138114.168482:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157993472 00000100:00100000:2.0:1783138114.168499:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157993472 00000100:00100000:2.0:1783138114.169278:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:2.0:1783138114.169294:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+10:18224:x1869755157993472:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783138114.169334:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138114.169367:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f421de200/0x50a9699713c4d102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x40dea3941757a74b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138114.169396:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f421de200/0x50a9699713c4d102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a74b expref: 11 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138114.169409:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f421de200/0x50a9699713c4d102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a74b expref: 11 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138114.169418:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f421de200, rc 0) 00000100:00100000:2.0:1783138114.169488:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+11:18224:x1869755157993472:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 199us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138114.169495:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:0.0:1783138114.177617:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138114.177696:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157993600 00000100:00100000:1.0:1783138114.177705:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157993600 00000100:00100000:1.0:1783138114.177758:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:1.0:1783138114.177768:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+11:18224:x1869755157993600:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783138114.177934:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+11:18224:x1869755157993600:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 166us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138114.177942:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:0.0:1783138114.197130:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138114.197444:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157993728 00000100:00100000:1.0:1783138114.197456:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157993728 00000100:00100000:1.0:1783138114.197515:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:1.0:1783138114.197526:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+11:18224:x1869755157993728:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783138114.197697:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+11:18224:x1869755157993728:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 173us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138114.197715:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:0.0:1783138114.216742:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138114.217673:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157993856 00000100:00100000:2.0:1783138114.217687:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157993856 00000100:00100000:2.0:1783138114.217760:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 136 00000100:00100000:2.0:1783138114.217772:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+11:18230:x1869755157993856:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783138114.217953:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+11:18230:x1869755157993856:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 182us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138114.217972:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 136 00000100:00100000:0.0:1783138114.244766:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138114.244862:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157993984 00000100:00100000:3.0:1783138114.244872:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157993984 00000100:00100000:3.0:1783138114.244932:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00100000:3.0:1783138114.244942:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+11:18230:x1869755157993984:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783138114.245102:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+11:18230:x1869755157993984:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 160us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138114.245110:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00100000:0.0:1783138114.271246:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138114.271365:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157994112 00000100:00100000:1.0:1783138114.271376:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157994112 00000100:00100000:1.0:1783138114.271428:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:1.0:1783138114.271439:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+11:18230:x1869755157994112:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783138114.271603:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+11:18230:x1869755157994112:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 165us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138114.271612:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:0.0:1783138114.290646:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138114.290881:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157994240 00000100:00100000:2.0:1783138114.290892:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157994240 00000100:00100000:2.0:1783138114.290948:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:2.0:1783138114.290958:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+11:18224:x1869755157994240:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783138114.290975:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138114.290994:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f421dea00/0x50a9699713c4d109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x40dea3941757a77c expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138114.291172:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f421dea00/0x50a9699713c4d109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a77c expref: 12 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138114.291184:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f421dea00/0x50a9699713c4d109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a77c expref: 12 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138114.291194:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f421dea00, rc 0) 00000100:00100000:2.0:1783138114.291253:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+12:18224:x1869755157994240:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 297us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138114.291260:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:2.0:1783138114.297413:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138114.305362:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157994368 00000100:00100000:3.0:1783138114.305377:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157994368 00000100:00100000:3.0:1783138114.305516:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 140 00000100:00100000:3.0:1783138114.305528:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+12:18224:x1869755157994368:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783138114.305558:0:22735:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783138114.305582:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783138114.305586:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783138114.305590:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783138114.305593:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1783138114.305595:0:22735:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1783138114.308568:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+12:18224:x1869755157994368:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 3033us (11155us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138114.308581:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 140 00000100:00100000:0.0:1783138114.317434:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138114.317531:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157994496 00000100:00100000:2.0:1783138114.317541:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157994496 00000100:00100000:2.0:1783138114.317596:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 141 00000100:00100000:2.0:1783138114.317607:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+12:18224:x1869755157994496:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783138114.317623:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138114.317639:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f3098ec00/0x50a9699713c4d110 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x40dea3941757a783 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138114.317668:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f3098ec00/0x50a9699713c4d110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a783 expref: 13 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138114.317679:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f3098ec00/0x50a9699713c4d110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a783 expref: 13 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138114.317689:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f3098ec00, rc 0) 00000100:00100000:2.0:1783138114.317754:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+13:18224:x1869755157994496:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 141us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138114.317984:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 141 00000100:00100000:2.0:1783138114.332311:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138114.332653:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157994624 00000100:00100000:3.0:1783138114.332663:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157994624 00000100:00100000:3.0:1783138114.332724:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 142 00000100:00100000:3.0:1783138114.332735:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+13:18224:x1869755157994624:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783138114.332896:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+13:18224:x1869755157994624:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 162us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138114.332905:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 142 00000100:00100000:0.0:1783138114.338200:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138114.338345:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157994752 00000100:00100000:2.0:1783138114.338355:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157994752 00000100:00100000:2.0:1783138114.338415:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:2.0:1783138114.338426:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+13:18224:x1869755157994752:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783138114.338562:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+13:18224:x1869755157994752:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 137us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138114.338571:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:0.0:1783138114.342855:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138114.349394:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157994880 00000100:00100000:1.0:1783138114.349409:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157994880 00000100:00100000:1.0:1783138114.349485:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:1.0:1783138114.349496:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+13:18237:x1869755157994880:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783138114.349651:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+13:18237:x1869755157994880:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 156us (6805us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138114.349660:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:0.0:1783138114.352664:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138114.352760:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157995008 00000100:00100000:3.0:1783138114.352769:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157995008 00000100:00100000:3.0:1783138114.352828:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:3.0:1783138114.352839:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0af3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+13:18237:x1869755157995008:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783138114.353025:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0af3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+13:18237:x1869755157995008:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 186us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138114.353033:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:0.0:1783138114.361212:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138114.361256:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138114.361294:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138114.361360:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138114.361380:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138114.361646:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157995520 00000100:00100000:1.0:1783138114.361656:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157995520 00000100:00100000:1.0:1783138114.361711:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157995648 00000100:00100000:1.0:1783138114.361714:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157995648 00000100:00100000:1.0:1783138114.361738:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1783138114.361746:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2400:x1869755157995520:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138114.361825:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2400:x1869755157995520:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 79us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138114.361833:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1783138114.361849:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1783138114.361880:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2400:x1869755157995648:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138114.361906:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2400:x1869755157995648:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 30us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138114.361923:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1783138114.361945:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157995136 00000100:00100000:1.0:1783138114.361949:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157995136 00000100:00100000:1.0:1783138114.361970:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157995264 00000100:00100000:1.0:1783138114.361973:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157995264 00000100:00100000:1.0:1783138114.361988:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157995392 00000100:00100000:1.0:1783138114.361990:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157995392 00000100:00100000:1.0:1783138114.362016:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:1.0:1783138114.362023:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:2400:x1869755157995264:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1783138114.362042:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:1.0:1783138114.362053:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:2400:x1869755157995264:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 29us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138114.362059:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2400:x1869755157995392:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138114.362066:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:1.0:1783138114.362083:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1783138114.362088:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1869755157995136:12345-192.168.203.43@tcp:38:mount.lustre.0 00000100:00100000:2.0:1783138114.362101:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2400:x1869755157995392:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 49us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138114.362109:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00010000:00080000:1.0:1783138114.362123:0:22742:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from de7fa2be-2332-44b8-b80c-0dcb0b83c02e@192.168.203.43@tcp t0 exp 0000000000000000 cur 776 last 0 00000020:00000080:1.0:1783138114.362160:0:22742:0:(genops.c:1406:class_connect()) connect: client de7fa2be-2332-44b8-b80c-0dcb0b83c02e, cookie 0x50a9699713c4d117 00000004:00100000:1.0:1783138114.362189:0:22742:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783138114.362294:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9e3e038df000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783138114.362365:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:2399:x1869755157995136:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 275us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138114.362372:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00010000:00010000:2.0:1783138114.362893:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138114.363301:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138114.363426:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157995904 00000100:00100000:2.0:1783138114.363432:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157995904 00000100:00100000:2.0:1783138114.363469:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1783138114.363476:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1869755157995904:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783138114.363502:0:22744:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from de7fa2be-2332-44b8-b80c-0dcb0b83c02e@192.168.203.43@tcp t0 exp 0000000000000000 cur 776 last 0 00000020:00000080:2.0:1783138114.363533:0:22744:0:(genops.c:1406:class_connect()) connect: client de7fa2be-2332-44b8-b80c-0dcb0b83c02e, cookie 0x50a9699713c4d11e 00000004:00100000:2.0:1783138114.363554:0:22744:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783138114.363623:0:22744:0:(import.c:65:import_set_state_nolock()) ffff9e3f3564d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783138114.363678:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:2399:x1869755157995904:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 201us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138114.363698:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1783138114.379723:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138114.379950:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138114.380053:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138114.380369:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157996032 00000100:00100000:2.0:1783138114.380381:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157996032 00000100:00100000:2.0:1783138114.380444:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157995776 00000100:00100000:2.0:1783138114.380447:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157995776 00000100:00100000:2.0:1783138114.380461:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157996160 00000100:00100000:2.0:1783138114.380463:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157996160 00000100:00100000:2.0:1783138114.380477:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1783138114.380485:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:0:x1869755157996032:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783138114.380525:0:22744:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783138114.380590:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:0:x1869755157996032:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 105us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138114.380598:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1783138114.380617:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1783138114.380623:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+7:0:x1869755157995776:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783138114.380640:0:22744:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783138114.380668:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+7:0:x1869755157995776:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 46us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138114.380674:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1783138114.380686:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1783138114.380692:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:18224:x1869755157996160:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783138114.380702:0:22744:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783138114.380724:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:18224:x1869755157996160:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 32us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138114.380758:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00080000:3.0:1783138114.381927:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783138114.381935:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783138114.386431:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138114.386550:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157996288 00000100:00100000:0.0:1783138114.386562:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157996288 00000100:00100000:0.0:1783138114.386627:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:0.0:1783138114.386637:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:18224:x1869755157996288:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783138114.386732:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:18224:x1869755157996288:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 96us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138114.386740:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:0.0:1783138114.389094:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138114.389175:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138114.389209:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138114.389346:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157996416 00000100:00100000:1.0:1783138114.389370:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157996416 00000100:00100000:1.0:1783138114.389415:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157996544 00000100:00100000:1.0:1783138114.389418:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157996544 00000100:00100000:1.0:1783138114.389440:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1783138114.389448:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1869755157996416:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783138114.389485:0:24248:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from de7fa2be-2332-44b8-b80c-0dcb0b83c02e@192.168.203.43@tcp t0 exp 0000000000000000 cur 776 last 0 00000020:00000080:1.0:1783138114.389520:0:24248:0:(genops.c:1406:class_connect()) connect: client de7fa2be-2332-44b8-b80c-0dcb0b83c02e, cookie 0x50a9699713c4d125 00002000:00100000:1.0:1783138114.389532:0:24248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli de7fa2be-2332-44b8-b80c-0dcb0b83c02e/ffff9e3e038df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783138114.389542:0:24248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783138114.389611:0:24248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783138114.389641:0:24248:0:(import.c:65:import_set_state_nolock()) ffff9e3e038d8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783138114.389700:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:2399:x1869755157996416:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 251us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138114.389708:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1783138114.389725:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:1.0:1783138114.389730:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1869755157996544:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783138114.389757:0:24248:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from de7fa2be-2332-44b8-b80c-0dcb0b83c02e@192.168.203.43@tcp t0 exp 0000000000000000 cur 776 last 0 00000020:00000080:1.0:1783138114.389772:0:24248:0:(genops.c:1406:class_connect()) connect: client de7fa2be-2332-44b8-b80c-0dcb0b83c02e, cookie 0x50a9699713c4d12c 00002000:00100000:1.0:1783138114.389777:0:24248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli de7fa2be-2332-44b8-b80c-0dcb0b83c02e/ffff9e3e038de000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113655 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783138114.389784:0:24248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783138114.389816:0:24248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783138114.389830:0:24248:0:(import.c:65:import_set_state_nolock()) ffff9e3e038d9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783138114.389851:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:2399:x1869755157996544:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 120us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138114.389857:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1783138114.390984:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157996672 00000100:00100000:3.0:1783138114.390996:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157996672 00000100:00100000:1.0:1783138114.391177:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:1.0:1783138114.391186:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:18224:x1869755157996672:12345-192.168.203.43@tcp:900:mount.lustre.0 00000100:00100000:1.0:1783138114.391259:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:18224:x1869755157996672:12345-192.168.203.43@tcp:900:mount.lustre.0 Request processed in 74us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138114.391267:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1783138114.394062:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138114.394192:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157996800 00000100:00100000:3.0:1783138114.394202:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157996800 00000100:00100000:3.0:1783138114.394259:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:3.0:1783138114.394269:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:18224:x1869755157996800:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783138114.394389:0:22746:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783138114.394466:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:18224:x1869755157996800:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 198us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138114.394488:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:3.0:1783138114.608252:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138114.608392:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157996928 00000100:00100000:0.0:1783138114.608402:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157996928 00000100:00100000:0.0:1783138114.608465:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:0.0:1783138114.608475:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:18260:x1869755157996928:12345-192.168.203.43@tcp:101:mkdir.0 00010000:00010000:0.0:1783138114.608495:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138114.608530:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffe00/0x50a9699713c4d133 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a7b4 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138114.608602:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138114.608619:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138114.608633:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783138114.608688:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783138114.608693:0:22743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783138114.608716:0:22743:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138114.608757:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffe00/0x50a9699713c4d133 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7b4 expref: 8 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138114.608779:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7b4 expref: 7 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138114.608787:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3f3e1c9300) 00010000:00010000:0.0:1783138114.608790:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783138114.608794:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028fe400, rc 0) 00000100:00100000:0.0:1783138114.608863:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+7:18260:x1869755157996928:12345-192.168.203.43@tcp:101:mkdir.0 Request processed in 390us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138114.608871:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00010000:00010000:0.0:1783138115.391853:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138116.410876:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783138116.993725:0:24245:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of de7fa2be-2332-44b8-b80c-0dcb0b83c02e 00000001:00100000:2.0:1783138116.993739:0:24245:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10dbad77-f39f-415a-b3e7-d386fe5df21f 00000001:00100000:0.0:1783138116.993991:0:22722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of de7fa2be-2332-44b8-b80c-0dcb0b83c02e 00000001:00100000:0.0:1783138116.993999:0:22722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10dbad77-f39f-415a-b3e7-d386fe5df21f 00000001:00100000:0.0:1783138116.997981:0:23476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of de7fa2be-2332-44b8-b80c-0dcb0b83c02e 00000001:00100000:0.0:1783138116.997993:0:23476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 10dbad77-f39f-415a-b3e7-d386fe5df21f 00000001:00100000:1.0:1783138116.998077:0:25064:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of de7fa2be-2332-44b8-b80c-0dcb0b83c02e 00000001:00100000:1.0:1783138116.998084:0:25064:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10dbad77-f39f-415a-b3e7-d386fe5df21f 00010000:00010000:3.0:1783138117.434407:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783138117.497713:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03a7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175942400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783138117.497782:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138117.497873:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175942400 00000100:00100000:2.0:1783138117.497880:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175942400 00000100:00100000:2.0:1783138117.497955:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783138117.497964:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175942400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783138117.497994:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783138117.498052:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175942400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138117.498059:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1783138117.498086:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783138117.498111:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03a7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175942400:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1783138117.785554:0:25621:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1783138118.014754:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175942528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783138118.015021:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138118.015093:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783138118.015101:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175942656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138118.015128:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138118.015433:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175942528 00000100:00100000:0.0:1783138118.015442:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175942528 00000100:00100000:0.0:1783138118.015494:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175942656 00000100:00100000:0.0:1783138118.015497:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175942656 00000100:00100000:0.0:1783138118.015511:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783138118.015519:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175942528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783138118.015555:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783138118.015609:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175942528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138118.015617:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783138118.015635:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783138118.015641:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175942656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783138118.015659:0:22747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783138118.015689:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175942656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138118.015695:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783138118.016750:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175942656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138118.016770:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175942528:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783138118.459260:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138119.037717:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783138119.037764:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175942784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783138119.037873:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138119.038058:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175942784 00000100:00100000:1.0:1783138119.038070:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175942784 00000100:00100000:1.0:1783138119.038180:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783138119.038192:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175942784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783138119.038234:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00080000:3.0:1783138119.038394:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783138119.038955:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783138119.038977:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175942912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783138119.039027:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138119.040158:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175942784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1960us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138119.040174:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783138119.040212:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175942912 00000100:00100000:1.0:1783138119.040220:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175942912 00000100:00100000:1.0:1783138119.040277:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783138119.040286:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e02568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175942912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783138119.040328:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783138119.040394:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e02568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175942912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138119.040401:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783138119.040835:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175942784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783138119.040898:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175942912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783138119.041546:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e02569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175943168:0@lo:400:kworker.0 00000100:00100000:0.0:1783138119.041638:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138119.041691:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138119.041699:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175943040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783138119.041730:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138119.041791:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175943168 00000100:00100000:0.0:1783138119.041799:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175943168 00000100:00100000:0.0:1783138119.041849:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783138119.041859:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:3659:x1869755175943168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138119.041911:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:3659:x1869755175943168:12345-0@lo:400:kworker.0 Request processed in 53us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138119.041919:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783138119.041971:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e02569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175943168:0@lo:400:kworker.0 00000100:00100000:0.0:1783138119.041995:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175943040 00000100:00100000:0.0:1783138119.041998:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175943040 00000100:00100000:0.0:1783138119.042029:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783138119.042036:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175943040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783138119.042051:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1783138119.042100:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175943040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138119.042106:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783138119.042139:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175943040:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783138119.042650:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783138119.042656:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783138119.043368:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175943296:0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.043447:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138119.043488:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e02568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175943808:0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.043516:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138119.043533:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869755175944320:0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.043559:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138119.043603:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783138119.043614:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175943424:0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.043643:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138119.043671:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e02568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175943936:0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.043697:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138119.043741:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175943296 00000100:00100000:2.0:1783138119.043749:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175943296 00000100:00100000:2.0:1783138119.043810:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783138119.043834:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0256b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175943296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.043911:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0256b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175943296:12345-0@lo:400:kworker.0 Request processed in 91us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.043920:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783138119.044145:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175943808 00000100:00100000:2.0:1783138119.044153:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175943808 00000100:00100000:2.0:1783138119.044197:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175944320 00000100:00100000:2.0:1783138119.044201:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175944320 00000100:00100000:2.0:1783138119.044225:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175943424 00000100:00100000:2.0:1783138119.044228:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175943424 00000100:00100000:2.0:1783138119.044241:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175943936 00000100:00100000:2.0:1783138119.044244:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175943936 00000100:00100000:2.0:1783138119.044259:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783138119.044265:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e02569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175943808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.044301:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e02569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1869755175943808:12345-0@lo:400:kworker.0 Request processed in 36us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.044307:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783138119.044345:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783138119.044351:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e02569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869755175944320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.044380:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e02569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1869755175944320:12345-0@lo:400:kworker.0 Request processed in 29us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.044386:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783138119.044397:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783138119.044402:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e02569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175943424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.044428:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e02569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1869755175943424:12345-0@lo:400:kworker.0 Request processed in 26us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.044434:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783138119.044444:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783138119.044450:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e02568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175943936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.044477:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e02568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1869755175943936:12345-0@lo:400:kworker.0 Request processed in 28us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.044484:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783138119.044545:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1869755175943424:0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.044569:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e02568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1869755175943936:0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.044646:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175943296:0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.044656:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e02568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1869755175943808:0@lo:400:kworker.0 00010000:00080000:2.0:1783138119.044669:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e0256aa00 x1869755175944320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783138119.044679:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1869755175944320:0@lo:400:kworker.0 00000100:00100000:0.0:1783138119.044761:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175943680:0@lo:400:kworker.0 00000100:00100000:0.0:1783138119.044843:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138119.044895:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e02568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869755175944192:0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.044918:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175943680 00000100:00100000:2.0:1783138119.044926:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175943680 00000100:00100000:0.0:1783138119.044933:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138119.044968:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783138119.044978:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175943552:0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.044999:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783138119.045013:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138119.045016:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175943680:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783138119.046128:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783138119.046139:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783138119.046142:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783138119.046163:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175944192 00000100:00100000:1.0:1783138119.046171:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175944192 00000100:00100000:1.0:1783138119.046228:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783138119.046237:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869755175944192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.047181:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175943680:12345-0@lo:400:kworker.0 Request processed in 2162us (2328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.047198:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1783138119.048740:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783138119.048799:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175943552 00000100:00100000:3.0:1783138119.048811:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175943552 00000100:00100000:3.0:1783138119.048882:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783138119.048893:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175943552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138119.048996:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175943552:12345-0@lo:400:kworker.0 Request processed in 105us (3986us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138119.049004:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783138119.050922:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1869755175944192:12345-0@lo:400:kworker.0 Request processed in 4676us (5983us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138119.050938:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783138119.056926:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175943552:0@lo:400:kworker.0 00000100:00100000:0.0:1783138119.056943:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869755175944064:0@lo:400:kworker.0 00000100:00100000:0.0:1783138119.057011:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138119.057054:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175943680:0@lo:400:kworker.0 00000100:00100000:0.0:1783138119.057068:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e02568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1869755175944192:0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.057142:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175944064 00000100:00100000:2.0:1783138119.057161:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175944064 00000100:00100000:2.0:1783138119.057350:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783138119.057363:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869755175944064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138119.057473:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1869755175944064:12345-0@lo:400:kworker.0 Request processed in 112us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.057481:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1783138119.057523:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783138119.057628:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3e0256b800 x1869755175944064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783138119.057641:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1869755175944064:0@lo:400:kworker.0 00000100:00100000:1.0:1783138119.428763:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138119.428805:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138119.428827:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138119.428847:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138119.428870:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138119.428892:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138119.428910:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138119.428926:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138119.428955:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138119.428967:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157997056 00000100:00100000:2.0:1783138119.428978:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157997056 00000100:00100000:1.0:1783138119.428992:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157997312 00000100:00100000:1.0:1783138119.428997:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157997312 00000100:00100000:2.0:1783138119.429037:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:1.0:1783138119.429042:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157997824 00000100:00100000:1.0:1783138119.429047:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157997824 00000100:00100000:2.0:1783138119.429051:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+13:2400:x1869755157997056:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138119.429065:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157997184 00000100:00100000:1.0:1783138119.429070:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157997184 00000100:00100000:1.0:1783138119.429097:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157997696 00000100:00100000:1.0:1783138119.429099:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157997696 00000100:00100000:1.0:1783138119.429115:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:1.0:1783138119.429129:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2400:x1869755157997312:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1783138119.429152:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+13:2400:x1869755157997056:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 103us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.429161:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:3.0:1783138119.429171:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:1.0:1783138119.429181:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2400:x1869755157997312:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 56us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138119.429187:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2400:x1869755157997824:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138119.429195:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:2.0:1783138119.429200:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157997568 00000100:00100000:2.0:1783138119.429205:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157997568 00000100:00100000:1.0:1783138119.429215:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:1.0:1783138119.429225:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2400:x1869755157997184:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1783138119.429233:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157998080 00000100:00100000:2.0:1783138119.429237:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157998080 00000100:00100000:3.0:1783138119.429242:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2400:x1869755157997824:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 59us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138119.429252:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:2.0:1783138119.429258:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157997440 00000100:00100000:2.0:1783138119.429263:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157997440 00000100:00100000:1.0:1783138119.429264:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2400:x1869755157997184:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 39us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138119.429276:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:2.0:1783138119.429284:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157997952 00000100:00100000:1.0:1783138119.429284:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:2.0:1783138119.429289:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157997952 00000100:00100000:3.0:1783138119.429290:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:2400:x1869755157997696:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1783138119.429329:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1783138119.429339:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2400:x1869755157997568:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1783138119.429349:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:2400:x1869755157997696:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 63us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138119.429357:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:2.0:1783138119.429374:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2400:x1869755157997568:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 35us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.429383:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1783138119.429398:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1783138119.429405:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2400:x1869755157998080:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1783138119.429427:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2400:x1869755157998080:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 23us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.429444:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1783138119.429455:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1783138119.429461:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2400:x1869755157997440:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1783138119.429482:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2400:x1869755157997440:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 21us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.429496:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1783138119.429506:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:2.0:1783138119.429511:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2400:x1869755157997952:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1783138119.429529:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2400:x1869755157997952:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 18us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138119.429535:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00080000:1.0:1783138119.432197:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783138119.432205:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783138119.432209:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783138119.432211:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783138119.482581:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783138119.802066:0:22776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783138120.508153:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783138121.497931:0:25769:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee248d920 20000000:00000080:3.0:1783138121.497953:0:25769:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e3f356a4c00 uarg=0000000000000000 20000000:01000000:3.0:1783138121.497999:0:25769:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783138121.498005:0:25769:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783138121.498011:0:25769:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783138121.502644:0:25770:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1783138121.502849:0:25769:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783138121.511289:0:25769:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783138121.511345:0:25769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.511364:0:25769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3e028ffa00/0x50a9699713c4cd9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cd97 expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.511372:0:25769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3f341ff800/0x50a9699713c4cdac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cda5 expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.511378:0:25769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3f341fe600/0x50a9699713c4cdeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4cde4 expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.511384:0:25769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3e041f9400/0x50a9699713c4ce85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4ce7e expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.511392:0:25769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3e028b9600/0x50a9699713c4d0d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a713 expref: 12 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.511399:0:25769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e3f3098ec00/0x50a9699713c4d110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a783 expref: 12 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.511406:0:25769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.511463:0:25769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3f3098ec00/0x50a9699713c4d110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a783 expref: 12 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.511480:0:25769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3f3098ec00/0x50a9699713c4d110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a783 expref: 12 pid: 22737 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138121.511493:0:25769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175944448:192.168.203.43@tcp:104: 00010000:00010000:3.0:1783138121.512833:0:25769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3e028b9600/0x50a9699713c4d0d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a713 expref: 12 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.512847:0:25769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3e028b9600/0x50a9699713c4d0d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a713 expref: 12 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138121.512858:0:25769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175944576:192.168.203.43@tcp:104: 00010000:00010000:3.0:1783138121.512912:0:25769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3e041f9400/0x50a9699713c4ce85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4ce7e expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.512920:0:25769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3e041f9400/0x50a9699713c4ce85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4ce7e expref: 23 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138121.512930:0:25769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175944704:0@lo:104: 00000100:00100000:3.0:1783138121.513551:0:25769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783138121.513632:0:25769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3f341fe600/0x50a9699713c4cdeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4cde4 expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.513643:0:25769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3f341fe600/0x50a9699713c4cdeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4cde4 expref: 23 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138121.513673:0:25769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175944832:0@lo:104: 00000100:00100000:3.0:1783138121.513709:0:25769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783138121.514466:0:25769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3f341ff800/0x50a9699713c4cdac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4cda5 expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.514478:0:25769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3f341ff800/0x50a9699713c4cdac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4cda5 expref: 23 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138121.514488:0:25769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175944960:0@lo:104: 00000100:00100000:3.0:1783138121.514518:0:25769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138121.514616:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175944704 00000100:00100000:0.0:1783138121.514623:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175944704 00000100:00100000:0.0:1783138121.514658:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175944832 00000100:00100000:0.0:1783138121.514660:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175944832 00000100:00100000:0.0:1783138121.514674:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138121.514681:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+4:25769:x1869755175944704:12345-0@lo:104: 00010000:00010000:0.0:1783138121.514693:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.514745:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783138121.514751:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+4:25769:x1869755175944704:12345-0@lo:104: Request processed in 70us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138121.514758:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783138121.514774:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783138121.514780:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+3:25769:x1869755175944832:12345-0@lo:104: 00010000:00010000:0.0:1783138121.514787:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.514831:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783138121.514835:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+3:25769:x1869755175944832:12345-0@lo:104: Request processed in 56us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138121.514841:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1783138121.514859:0:25131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138121.514864:0:25131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.514871:0:25131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f479c00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:0.0:1783138121.514876:0:25131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.514884:0:25131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138121.514891:0:25131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138121.514896:0:25131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783138121.514921:0:25131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.514926:0:25131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138121.518218:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138121.518234:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138121.518247:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3f478a00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:2.0:1783138121.518252:0:22730:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138121.518262:0:22730:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783138121.518269:0:22730:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138121.518275:0:22730:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783138121.518353:0:22730:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138121.518361:0:22730:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783138121.518398:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138121.518424:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f3f478a00/0x50a9699713c4cde4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cdeb expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138121.518442:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138121.518445:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138121.518446:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138121.518476:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff132a53-abfa-4987-a345-1706880f10ac:3661:1869755175945088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138121.518543:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138121.518602:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175945216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138121.518625:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138121.518658:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175945088 00000100:00100000:2.0:1783138121.518665:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175945088 00010000:00010000:2.0:1783138121.518690:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3e041f9400/0x50a9699713c4ce85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4ce7e expref: 24 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138121.518714:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175945216 00000100:00100000:2.0:1783138121.518717:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175945216 00010000:00010000:2.0:1783138121.518727:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3f341fe600/0x50a9699713c4cdeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cde4 expref: 25 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138121.518740:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138121.518748:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e02568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff132a53-abfa-4987-a345-1706880f10ac+25:3661:x1869755175945088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138121.518759:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138121.518764:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3e041f9400/0x50a9699713c4ce85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4ce7e expref: 25 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138121.518773:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3e041f9400/0x50a9699713c4ce85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4ce7e expref: 25 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138121.518798:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138121.518833:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e02568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff132a53-abfa-4987-a345-1706880f10ac+25:3661:x1869755175945088:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138121.518840:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783138121.518855:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783138121.518862:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0256a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff132a53-abfa-4987-a345-1706880f10ac+24:3658:x1869755175945216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138121.518869:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138121.518873:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3f341fe600/0x50a9699713c4cdeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cde4 expref: 24 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138121.518880:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3f341fe600/0x50a9699713c4cdeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4cde4 expref: 24 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138121.518889:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138121.518914:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0256a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff132a53-abfa-4987-a345-1706880f10ac+24:3658:x1869755175945216:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138121.518920:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783138121.518966:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff132a53-abfa-4987-a345-1706880f10ac:3658:1869755175945216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783138121.518993:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff132a53-abfa-4987-a345-1706880f10ac:3661:1869755175945088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138121.519135:0:25131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519144:0:25131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f3f479c00/0x50a9699713c4ce7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4ce85 expref: -99 pid: 25063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519176:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138121.519178:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138121.519180:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138121.519277:0:25769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e3e028ffa00/0x50a9699713c4cd9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x50a9699713c4cd97 expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.519288:0:25769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e3e028ffa00/0x50a9699713c4cd9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x50a9699713c4cd97 expref: 23 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138121.519298:0:25769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f880e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175945344:0@lo:104: 00000100:00100000:3.0:1783138121.519348:0:25769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138121.519358:0:25769:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f02bcd780 going to sleep for 11 seconds 00010000:00010000:3.0:1783138121.519372:0:25769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e041f9400/0x50a9699713c4ce85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4ce7e expref: 23 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138121.519382:0:25769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175944704:0@lo:104: 00010000:00010000:3.0:1783138121.519391:0:25769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f341fe600/0x50a9699713c4cdeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4cde4 expref: 22 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138121.519398:0:25769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175944832:0@lo:104: 00000100:00100000:0.0:1783138121.519459:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175944960 00000100:00100000:0.0:1783138121.519463:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175944960 00000100:00100000:0.0:1783138121.519486:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175945344 00000100:00100000:0.0:1783138121.519488:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175945344 00000100:00100000:0.0:1783138121.519500:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783138121.519505:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+4:25769:x1869755175944960:12345-0@lo:104: 00010000:00010000:0.0:1783138121.519513:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519564:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783138121.519568:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+4:25769:x1869755175944960:12345-0@lo:104: Request processed in 64us (5051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138121.519574:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783138121.519586:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138121.519591:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+3:25769:x1869755175945344:12345-0@lo:104: 00010000:00010000:0.0:1783138121.519598:0:22725:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519630:0:22725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783138121.519635:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff132a53-abfa-4987-a345-1706880f10ac+3:25769:x1869755175945344:12345-0@lo:104: Request processed in 45us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138121.519641:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1783138121.519655:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783138121.519659:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519672:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f341fe200 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:0.0:1783138121.519676:0:22731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519683:0:22731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138121.519690:0:22731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138121.519695:0:22731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783138121.519718:0:22731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519724:0:22731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783138121.519737:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519744:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f341fe200/0x50a9699713c4cda5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cdac expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519754:0:22731:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783138121.519757:0:22731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519763:0:22731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f341ffe00 already unused, calling callback (ffffffffc14ecc20) 10000000:00010000:0.0:1783138121.519765:0:22731:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519782:0:22731:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783138121.519788:0:22731:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138121.519793:0:22731:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783138121.519805:0:22731:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519811:0:22731:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783138121.519823:0:22731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519831:0:22731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff9e3f341ffe00/0x50a9699713c4cd97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x50a9699713c4cd9e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.519843:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138121.519845:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783138121.519847:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138121.519855:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175945472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138121.519881:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138121.519906:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175945600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138121.519928:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138121.520024:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175945472 00000100:00100000:0.0:1783138121.520028:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175945472 00010000:00010000:0.0:1783138121.520049:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3f341ff800/0x50a9699713c4cdac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cda5 expref: 22 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138121.520089:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175945600 00000100:00100000:0.0:1783138121.520092:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175945600 00010000:00010000:0.0:1783138121.520103:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3e028ffa00/0x50a9699713c4cd9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cd97 expref: 23 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138121.520115:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783138121.520120:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+23:3659:x1869755175945472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138121.520143:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138121.520149:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3f341ff800/0x50a9699713c4cdac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cda5 expref: 23 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.520157:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3f341ff800/0x50a9699713c4cdac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4cda5 expref: 23 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.520168:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138121.520195:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+23:3659:x1869755175945472:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138121.520201:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783138121.520213:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138121.520219:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+22:3660:x1869755175945600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783138121.520226:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138121.520229:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3e028ffa00/0x50a9699713c4cd9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x50a9699713c4cd97 expref: 22 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.520237:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3e028ffa00/0x50a9699713c4cd9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x50a9699713c4cd97 expref: 22 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.520246:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138121.520277:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff132a53-abfa-4987-a345-1706880f10ac+22:3660:x1869755175945600:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138121.520283:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783138121.520334:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff132a53-abfa-4987-a345-1706880f10ac:3659:1869755175945472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783138121.520357:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175945600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783138121.520432:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138121.520522:0:25769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f341ff800/0x50a9699713c4cdac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4cda5 expref: 21 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138121.520540:0:25769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175944960:0@lo:104: 00010000:00010000:3.0:1783138121.520554:0:25769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028ffa00/0x50a9699713c4cd9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x50a9699713c4cd97 expref: 20 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138121.520562:0:25769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f880e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175945344:0@lo:104: 00000100:00100000:3.0:1783138121.521227:0:25769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175944448:192.168.203.43@tcp:104: 00000100:00100000:3.0:1783138121.521238:0:25769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25769:1869755175944576:192.168.203.43@tcp:104: 00010000:00010000:3.0:1783138121.521280:0:25769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.530000:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783138121.530177:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138121.530298:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138121.530933:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157998208 00000100:00100000:0.0:1783138121.530955:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157998208 00010000:00010000:0.0:1783138121.531000:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3f3098ec00/0x50a9699713c4d110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a783 expref: 13 pid: 22737 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138121.531036:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157998336 00000100:00100000:0.0:1783138121.531039:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157998336 00010000:00010000:0.0:1783138121.531051:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e3e028b9600/0x50a9699713c4d0d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a713 expref: 14 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138121.531074:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1783138121.531083:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2c2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e64806b-c006-4a0c-9437-03f90192be80+14:2402:x1869755157998208:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783138121.531108:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138121.531114:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3f3098ec00/0x50a9699713c4d110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a783 expref: 14 pid: 22737 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531126:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3f3098ec00/0x50a9699713c4d110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a783 expref: 14 pid: 22737 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531143:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3f3098ec00/0x50a9699713c4d110 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a783 expref: 14 pid: 22737 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531159:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138121.531233:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2c2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e64806b-c006-4a0c-9437-03f90192be80+13:2402:x1869755157998208:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 150us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138121.531241:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1783138121.531284:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1783138121.531291:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0256aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e64806b-c006-4a0c-9437-03f90192be80+12:2402:x1869755157998336:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783138121.531298:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138121.531303:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e3e028b9600/0x50a9699713c4d0d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a713 expref: 12 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531330:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e3e028b9600/0x50a9699713c4d0d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a713 expref: 12 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531340:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028b9600/0x50a9699713c4d0d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a713 expref: 12 pid: 22735 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531351:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531358:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531372:0:22728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531380:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531386:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531391:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531403:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9e00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138121.531408:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531416:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531428:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138121.531438:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138121.531459:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0256aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e64806b-c006-4a0c-9437-03f90192be80+11:2402:x1869755157998336:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 168us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138121.531465:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00010000:00010000:3.0:1783138121.531758:0:25769:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.531768:0:25769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138121.531776:0:25769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d141 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138122.553594:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138122.617706:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175945728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138122.617783:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138122.617963:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175945728 00000100:00100000:1.0:1783138122.617972:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175945728 00000100:00100000:1.0:1783138122.618040:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783138122.618061:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175945728:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783138122.618094:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1783138122.618097:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783138122.618155:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1869755175945728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138122.618162:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783138122.618253:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1869755175945728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783138122.993145:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138122.993377:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157998464 00000100:00100000:2.0:1783138122.993393:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157998464 00000100:00100000:2.0:1783138122.993499:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:2.0:1783138122.993509:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:18727:x1869755157998464:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783138122.993552:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138122.993576:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a7bb expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.993662:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d14f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.993681:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d14f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.993694:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d14f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.993711:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d156 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.993722:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.993732:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.993823:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e400/0x50a9699713c4d15d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.993831:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e400/0x50a9699713c4d15d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.993838:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e400/0x50a9699713c4d15d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138122.993972:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783138122.993985:0:22744:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783138122.994038:0:22744:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e400/0x50a9699713c4d15d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.994059:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d14f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.994065:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d14f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.994071:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d14f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.994076:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3098f200 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:2.0:1783138122.994080:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d14f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.994087:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d14f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.994099:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3f3e1c9300) 00010000:00010000:2.0:1783138122.994103:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138122.994107:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d14f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.994113:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d14f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.994126:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.994132:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d156 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783138122.994219:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783138122.995761:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d156 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.995769:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3098e000 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:2.0:1783138122.995773:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d156 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.995782:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d156 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.995796:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e3f3e1c9800) 00010000:00010000:2.0:1783138122.995800:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138122.995804:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d156 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.995811:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d156 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.995860:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7bb expref: 8 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.995874:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e400/0x50a9699713c4d15d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7bb expref: 7 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138122.995881:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e3f3e1c9900) 00010000:00010000:2.0:1783138122.995884:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783138122.995886:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f3098e400, rc 0) 00000100:00100000:2.0:1783138122.995957:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:18727:x1869755157998464:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 2448us (2831us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138122.995975:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1783138123.003714:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.003789:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157998592 00000100:00100000:2.0:1783138123.003799:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157998592 00000100:00100000:2.0:1783138123.003848:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1783138123.003858:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:18727:x1869755157998592:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783138123.003936:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:18727:x1869755157998592:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.003944:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:0.0:1783138123.008913:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.009021:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157998848 00000100:00100000:2.0:1783138123.009031:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157998848 00000100:00100000:2.0:1783138123.009097:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:2.0:1783138123.009107:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:18727:x1869755157998848:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783138123.009126:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138123.009153:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d164 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a7c2 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009226:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d16b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009242:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d16b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009254:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d16b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009267:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d172 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009292:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d172 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009299:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d172 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009446:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f600/0x50a9699713c4d179 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009456:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f600/0x50a9699713c4d179 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009464:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f600/0x50a9699713c4d179 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138123.009473:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1783138123.009605:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d16b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009613:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d16b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009620:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d16b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009626:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3098e000 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:2.0:1783138123.009630:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d16b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009638:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d16b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009790:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e3f3e1c9900) 00010000:00010000:2.0:1783138123.009794:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138123.009799:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d16b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009806:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098e000/0x50a9699713c4d16b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009821:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d172 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009828:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d172 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009834:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d172 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009839:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3098f200 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:2.0:1783138123.009842:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d172 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009848:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d172 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009855:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e3f3e1c9800) 00010000:00010000:2.0:1783138123.009857:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138123.009860:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d172 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.009866:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f200/0x50a9699713c4d172 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.013470:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d164 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7c2 expref: 10 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.013500:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f600/0x50a9699713c4d179 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7c2 expref: 9 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.013510:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e3f3e1c9600) 00010000:00010000:2.0:1783138123.013512:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138123.013516:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f3098f600, rc 0) 00000100:00100000:2.0:1783138123.013662:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+9:18727:x1869755157998848:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 4554us (4756us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1783138123.013672:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1783138123.018848:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138123.026517:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157998976 00000100:00100000:0.0:1783138123.026536:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157998976 00000100:00100000:0.0:1783138123.026607:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:0.0:1783138123.026617:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+9:18727:x1869755157998976:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783138123.026904:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+9:18727:x1869755157998976:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 287us (8064us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138123.026912:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:1.0:1783138123.041651:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.041796:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157999104 00000100:00100000:2.0:1783138123.041808:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157999104 00000100:00100000:2.0:1783138123.041885:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:2.0:1783138123.041896:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:18727:x1869755157999104:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1783138123.042490:0:22743:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 539us 00000100:00080000:3.0:1783138123.044071:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 10000000:01000000:0.0:1783138123.066348:0:22739:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783138123.066373:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9e3e040f7000 from 13 10000000:01000000:0.0:1783138123.066379:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783138123.066432:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028fea00/0x50a9699713c4d187 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.066444:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3e028fea00/0x50a9699713c4d187 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.066455:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3e028fea00/0x50a9699713c4d187 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138123.066482:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175945856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783138123.066559:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138123.066604:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a9510c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138123.067234:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175945856 00000100:00100000:3.0:1783138123.067243:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175945856 00000100:00100000:3.0:1783138123.067404:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783138123.067423:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+20:22739:x1869755175945856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138123.067437:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138123.067452:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e028b9800/0x50a9699713c4d18e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4d187 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.067477:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028b9800/0x50a9699713c4d18e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4d187 expref: 21 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.067486:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e028b9800/0x50a9699713c4d18e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4d187 expref: 21 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.067496:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b9800, rc 0) 00000100:00100000:3.0:1783138123.067546:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff132a53-abfa-4987-a345-1706880f10ac+21:22739:x1869755175945856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138123.067553:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783138123.067637:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175945856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138123.067654:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3e028fea00/0x50a9699713c4d187 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d18e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.067663:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3e028fea00/0x50a9699713c4d187 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4d18e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138123.067741:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175945984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138123.067775:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138123.074699:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a9510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783138123.075308:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:18727:x1869755157999104:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 33408us (33660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138123.075347:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:2.0:1783138123.077058:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175945984 00000100:00100000:2.0:1783138123.077072:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175945984 00000100:00100000:2.0:1783138123.077135:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783138123.077145:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:22739:x1869755175945984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138123.077333:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:22739:x1869755175945984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (9557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.077340:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783138123.078977:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175945984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138123.079066:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783138123.079137:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138123.079180:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a9510c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138123.079306:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175946112 00000100:00100000:1.0:1783138123.079328:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175946112 00000100:00100000:1.0:1783138123.079382:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783138123.079398:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f0caf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:22739:x1869755175946112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138123.079498:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f0caf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:22739:x1869755175946112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138123.079505:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783138123.079587:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783138123.083908:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138123.084043:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157999232 00000100:00100000:1.0:1783138123.084063:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157999232 00000100:00100000:1.0:1783138123.084124:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:1.0:1783138123.084134:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e02568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+9:18733:x1869755157999232:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1783138123.084159:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138123.084181:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a7c9 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084244:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d19c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084258:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d19c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084272:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d19c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084357:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d1a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084365:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084371:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084426:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d19c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084433:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d19c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084439:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d19c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084446:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9600 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:1.0:1783138123.084450:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d19c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084457:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d19c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084470:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3f3e1c9300) 00010000:00010000:1.0:1783138123.084472:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138123.084477:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d19c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084483:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d19c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084496:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084501:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d1a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084506:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084519:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8e00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:1.0:1783138123.084522:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084529:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084537:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e3e03438200) 00010000:00010000:1.0:1783138123.084539:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138123.084542:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d1a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084547:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d1a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084579:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d195 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7c9 expref: 10 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084589:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3f3e1c9300) 00010000:00010000:1.0:1783138123.084591:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138123.084595:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7c9 expref: 10 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.084604:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e041f9c00, rc 0) 00000100:00100000:1.0:1783138123.084662:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e02568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+9:18733:x1869755157999232:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 530us (764us total) trans 0 rc 301/301 00000100:00100000:1.0:1783138123.084670:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000040:00080000:1.0:1783138123.087101:0:25783:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783138123.087416:0:22739:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783138123.087441:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783138123.087453:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028fea00/0x50a9699713c4d187 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d18e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.087464:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3e028fea00/0x50a9699713c4d187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d18e expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783138123.087545:0:22739:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783138123.087548:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9e3f043b6000 from 13 10000000:01000000:1.0:1783138123.087551:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783138123.087591:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8200/0x50a9699713c4d1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.087600:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8200/0x50a9699713c4d1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.087612:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8200/0x50a9699713c4d1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138123.087877:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03a7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783138123.088024:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138123.088126:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a9e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138123.088166:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175946240 00000100:00100000:2.0:1783138123.088174:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175946240 00000100:00100000:2.0:1783138123.088259:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783138123.088268:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+21:22739:x1869755175946240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138123.088281:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138123.088295:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f3098e000/0x50a9699713c4d1b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4d1aa expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.088430:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f3098e000/0x50a9699713c4d1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4d1aa expref: 22 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.088441:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f3098e000/0x50a9699713c4d1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4d1aa expref: 22 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.088449:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f3098e000, rc 0) 00000100:00100000:2.0:1783138123.088498:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+22:22739:x1869755175946240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.088505:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783138123.088590:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03a7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138123.088605:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8200/0x50a9699713c4d1aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d1b1 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.088614:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8200/0x50a9699713c4d1aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4d1b1 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138123.088694:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783138123.088724:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138123.089177:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f02bcdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783138123.089230:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175946368 00000100:00100000:0.0:1783138123.089235:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175946368 00000100:00100000:0.0:1783138123.089263:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783138123.089271:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+22:22739:x1869755175946368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138123.089421:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+22:22739:x1869755175946368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138123.089427:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783138123.089548:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783138123.089584:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783138123.089648:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138123.089665:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f02bcdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783138123.089849:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175946496 00000100:00100000:0.0:1783138123.089853:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175946496 00000100:00100000:0.0:1783138123.089872:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783138123.089877:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+22:22739:x1869755175946496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783138123.089974:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+22:22739:x1869755175946496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138123.089980:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783138123.090126:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f882300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783138123.091093:0:25784:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783138123.093974:0:22739:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783138123.094011:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783138123.094025:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8200/0x50a9699713c4d1aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d1b1 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.094036:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3e041f8200/0x50a9699713c4d1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d1b1 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783138123.094057:0:22739:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783138123.094060:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9e3e038cb000 from 13 10000000:01000000:0.0:1783138123.094063:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783138123.094104:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4d1b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.094112:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4d1b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.094123:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4d1b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138123.094149:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783138123.094215:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138123.094287:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a951180 going to sleep for 11 seconds 00000100:00100000:3.0:1783138123.094666:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175946624 00000100:00100000:3.0:1783138123.094674:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175946624 00000100:00100000:3.0:1783138123.094780:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783138123.094789:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+22:22739:x1869755175946624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138123.094803:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138123.094817:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d1bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4d1b8 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.094839:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d1bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4d1b8 expref: 23 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.094850:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e028b9e00/0x50a9699713c4d1bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4d1b8 expref: 23 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.094858:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b9e00, rc 0) 00000100:00100000:3.0:1783138123.094899:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+23:22739:x1869755175946624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138123.094906:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783138123.096107:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138123.096175:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783138123.096196:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4d1b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d1bf expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.096207:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4d1b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4d1bf expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138123.096299:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138123.096360:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138123.096393:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a951180 going to sleep for 11 seconds 00000100:00100000:0.0:1783138123.096410:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175946752 00000100:00100000:0.0:1783138123.096414:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175946752 00000100:00100000:0.0:1783138123.096442:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783138123.096450:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+23:22739:x1869755175946752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138123.096561:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+23:22739:x1869755175946752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138123.096569:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783138123.096603:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783138123.096642:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783138123.097564:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157999360 00000100:00100000:3.0:1783138123.097573:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157999360 00000100:00100000:3.0:1783138123.097621:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1783138123.097644:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10dbad77-f39f-415a-b3e7-d386fe5df21f+9:18733:x1869755157999360:12345-192.168.203.43@tcp:700:lfs.0 00000100:00100000:0.0:1783138123.098119:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138123.098165:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175946880 00000100:00100000:2.0:1783138123.098170:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175946880 00000100:00100000:2.0:1783138123.098197:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783138123.098205:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+23:22739:x1869755175946880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783138123.098838:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10dbad77-f39f-415a-b3e7-d386fe5df21f+9:18733:x1869755157999360:12345-192.168.203.43@tcp:700:lfs.0 Request processed in 1192us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138123.098855:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1783138123.100774:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138123.101040:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a951180 going to sleep for 11 seconds 00000100:00100000:1.0:1783138123.101194:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157999616 00000100:00100000:1.0:1783138123.101203:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157999616 00000100:00100000:1.0:1783138123.101250:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:1.0:1783138123.101259:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+9:18733:x1869755157999616:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:1.0:1783138123.101431:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138123.101460:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f421dec00/0x50a9699713c4d0fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a744 expref: 9 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.101478:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3f3e1c9300) 00010000:00010000:1.0:1783138123.101482:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783138123.101536:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.101550:0:22742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7b4 expref: 5 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.101574:0:22742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.101608:0:22742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7b4 expref: 5 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.101621:0:22742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7b4 expref: 5 pid: 22743 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138123.101850:0:22742:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03a7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22742:1869755175947008:192.168.203.43@tcp:104: 00000100:00100000:1.0:1783138123.102030:0:22742:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a9e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1783138123.102142:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+23:22739:x1869755175946880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3936us (4023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.102152:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783138123.102252:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175946880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783138123.103435:0:25785:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783138123.103847:0:22739:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783138123.103869:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783138123.103880:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4d1b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d1bf expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.103903:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3e028ffe00/0x50a9699713c4d1b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d1bf expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783138123.103914:0:22739:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783138123.103917:0:22739:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9e3f3625b800 from 13 10000000:01000000:2.0:1783138123.103920:0:22739:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783138123.103969:0:22739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3098fa00/0x50a9699713c4d1cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.103977:0:22739:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff9e3f3098fa00/0x50a9699713c4d1cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.103988:0:22739:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff9e3f3098fa00/0x50a9699713c4d1cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138123.104010:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175947136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783138123.104081:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138123.104121:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3080b540 going to sleep for 11 seconds 00000100:00100000:3.0:1783138123.104223:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175947136 00000100:00100000:3.0:1783138123.104231:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175947136 00000100:00100000:3.0:1783138123.104279:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783138123.104288:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+23:22739:x1869755175947136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783138123.104302:0:22736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138123.104343:0:22736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3e028b8800/0x50a9699713c4d1d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x50a9699713c4d1cd expref: -99 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.104368:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3e028b8800/0x50a9699713c4d1d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x50a9699713c4d1cd expref: 24 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.104378:0:22736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3e028b8800/0x50a9699713c4d1d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x50a9699713c4d1cd expref: 24 pid: 22736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.104387:0:22736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b8800, rc 0) 00000100:00100000:3.0:1783138123.104428:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:22739:x1869755175947136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138123.104436:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783138123.104522:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175947136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783138123.104538:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff9e3f3098fa00/0x50a9699713c4d1cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d1d4 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.104546:0:22739:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff9e3f3098fa00/0x50a9699713c4d1cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x50a9699713c4d1d4 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138123.104604:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03a7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175947264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138123.104641:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138123.104669:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a9e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783138123.104836:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175947264 00000100:00100000:3.0:1783138123.104840:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175947264 00000100:00100000:3.0:1783138123.104872:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783138123.104878:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:22739:x1869755175947264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783138123.105168:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:22739:x1869755175947264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138123.105188:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783138123.105907:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03a7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175947264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138123.107197:0:22739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e03a7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175947392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138123.107281:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138123.107414:0:22739:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a9e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138123.108269:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175947392 00000100:00100000:2.0:1783138123.108278:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175947392 00000100:00100000:2.0:1783138123.108355:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783138123.108366:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:22739:x1869755175947392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783138123.108493:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff132a53-abfa-4987-a345-1706880f10ac+24:22739:x1869755175947392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.108500:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783138123.108616:0:22739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03a7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff132a53-abfa-4987-a345-1706880f10ac:22739:1869755175947392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783138123.109622:0:25786:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:0.0:1783138123.109906:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.110034:0:22742:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e03a7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22742:1869755175947008:192.168.203.43@tcp:104: 00010000:00010000:2.0:1783138123.110069:0:22742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138123.110209:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157999744 00000100:00100000:0.0:1783138123.110215:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157999744 00010000:00010000:0.0:1783138123.110254:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7b4 expref: 6 pid: 22743 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138123.110279:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1783138123.110287:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:2402:x1869755157999744:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783138123.110300:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138123.110306:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7b4 expref: 6 pid: 22743 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.110345:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7b4 expref: 6 pid: 22743 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.110367:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe400/0x50a9699713c4d13a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7b4 expref: 6 pid: 22743 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.110380:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3f3e1c9300) 00010000:00010000:0.0:1783138123.110385:0:22728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.110394:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.110402:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.110422:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138123.110468:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2402:x1869755157999744:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 181us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138123.110476:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00080000:0.0:1783138123.110495:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783138123.110598:0:22742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.110606:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.110636:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.110656:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.110663:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113268:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113290:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113300:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783138123.113341:0:22742:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd961081 reply state 00000000510d02fd transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113353:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113360:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e3f2a999900) 00010000:00010000:0.0:1783138123.113362:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783138123.113366:0:22742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783138123.113372:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783138123.113380:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113385:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113391:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113402:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9c00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:0.0:1783138123.113406:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113413:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113423:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3f3e1c9300) 00010000:00010000:0.0:1783138123.113425:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783138123.113428:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113433:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9c00/0x50a9699713c4d1c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783138123.113449:0:22742:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd961081 reply state 00000000510d02fd transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113457:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.113463:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e3f2a999700) 00010000:00010000:0.0:1783138123.113465:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783138123.113467:0:22742:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783138123.113566:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+10:18733:x1869755157999616:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 12303us (12796us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1783138123.113575:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000020:01000000:2.0:1783138123.114161:0:22739:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783138123.114193:0:22739:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783138123.114202:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff9e3f3098fa00/0x50a9699713c4d1cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d1d4 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.114212:0:22739:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff9e3f3098fa00/0x50a9699713c4d1cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x50a9699713c4d1d4 expref: -99 pid: 22739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138123.129655:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783138123.129684:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e02569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175947520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783138123.129761:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138123.129924:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3632c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175947648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783138123.129953:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138123.130000:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175947520 00000100:00100000:0.0:1783138123.130007:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175947520 00000100:00100000:0.0:1783138123.130058:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175947648 00000100:00100000:0.0:1783138123.130061:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175947648 00000100:00100000:0.0:1783138123.130077:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783138123.130084:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175947520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783138123.130118:0:23767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783138123.130163:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175947520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138123.130170:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783138123.130186:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783138123.130192:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175947648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783138123.130209:0:23767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783138123.130235:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175947648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138123.130240:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783138123.130280:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3632c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175947648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783138123.130292:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e02569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175947520:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1783138123.130922:0:23496:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783138123.268425:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138123.269113:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755157999872 00000100:00100000:1.0:1783138123.269123:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755157999872 00000100:00100000:1.0:1783138123.269175:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:1.0:1783138123.269185:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+10:18741:x1869755157999872:12345-192.168.203.43@tcp:101:lctl.0 00010000:00010000:1.0:1783138123.269213:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138123.269238:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d1e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a7d0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.269308:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8400/0x50a9699713c4d1f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.269356:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8400/0x50a9699713c4d1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.269369:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8400/0x50a9699713c4d1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138123.269418:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783138123.269422:0:22744:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783138123.269633:0:22744:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8400/0x50a9699713c4d1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.269677:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9600/0x50a9699713c4d1e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7d0 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.269694:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8400/0x50a9699713c4d1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7d0 expref: 11 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.269701:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3e03438200) 00010000:00010000:1.0:1783138123.269704:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783138123.269707:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e041f8400, rc 0) 00000100:00100000:1.0:1783138123.269765:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+11:18741:x1869755157999872:12345-192.168.203.43@tcp:101:lctl.0 Request processed in 580us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138123.269772:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:1.0:1783138123.294630:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138123.302678:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158000000 00000100:00100000:0.0:1783138123.302692:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158000000 00000100:00100000:0.0:1783138123.302754:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:0.0:1783138123.302765:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:18742:x1869755158000000:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1783138123.302785:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138123.302804:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff000/0x50a9699713c4d1f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a7d7 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.302886:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fec00/0x50a9699713c4d1fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.302903:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fec00/0x50a9699713c4d1fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.302914:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fec00/0x50a9699713c4d1fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783138123.302969:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783138123.302973:0:22743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783138123.302991:0:22743:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fec00/0x50a9699713c4d1fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.303014:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff000/0x50a9699713c4d1f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7d7 expref: 7 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.303031:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fec00/0x50a9699713c4d1fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7d7 expref: 6 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.303040:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3e03438200) 00010000:00010000:0.0:1783138123.303043:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783138123.303056:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028fec00, rc 0) 00000100:00100000:0.0:1783138123.303122:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:18742:x1869755158000000:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 358us (8503us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138123.303130:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:0.0:1783138123.306963:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138123.307183:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158000128 00000100:00100000:3.0:1783138123.307195:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158000128 00000100:00100000:3.0:1783138123.307251:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:3.0:1783138123.307259:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+6:18742:x1869755158000128:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1783138123.307277:0:23996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138123.307299:0:23996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a7de expref: -99 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307395:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d20c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307418:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d20c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307429:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d20c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307440:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d213 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307448:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d213 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307454:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d213 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307551:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9600/0x50a9699713c4d21a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307578:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9600/0x50a9699713c4d21a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307585:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9600/0x50a9699713c4d21a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138123.307627:0:23996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783138123.307631:0:23996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783138123.307650:0:23996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9600/0x50a9699713c4d21a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307661:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d20c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307667:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d20c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307673:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d20c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307679:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9a00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:3.0:1783138123.307684:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d20c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307692:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d20c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307704:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3e03438200) 00010000:00010000:3.0:1783138123.307708:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138123.307713:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d20c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307729:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d20c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307745:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d213 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307752:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d213 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307757:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d213 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307762:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8200 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:3.0:1783138123.307766:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d213 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307771:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d213 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307779:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e3f2a999700) 00010000:00010000:3.0:1783138123.307782:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138123.307785:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d213 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307790:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d213 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307816:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7de expref: 8 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307854:0:23996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9600/0x50a9699713c4d21a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7de expref: 7 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.307862:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e3f2a999900) 00010000:00010000:3.0:1783138123.307864:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783138123.307866:0:23996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b9600, rc 0) 00000100:00100000:3.0:1783138123.307930:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+7:18742:x1869755158000128:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 670us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138123.307938:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:3.0:1783138123.314919:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.315419:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158000256 00000100:00100000:2.0:1783138123.315430:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158000256 00000100:00100000:2.0:1783138123.315508:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1783138123.315518:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:18742:x1869755158000256:12345-192.168.203.43@tcp:900:lfs.0 00000100:00100000:2.0:1783138123.315606:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:18742:x1869755158000256:12345-192.168.203.43@tcp:900:lfs.0 Request processed in 88us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.315614:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00080000:0.0:1783138123.315732:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783138123.322349:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138123.322557:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158000512 00000100:00100000:0.0:1783138123.322568:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158000512 00000100:00100000:0.0:1783138123.322631:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:0.0:1783138123.322642:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+7:18742:x1869755158000512:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1783138123.322662:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138123.322695:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff000/0x50a9699713c4d221 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a7e5 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783138123.322802:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783138123.322911:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff000/0x50a9699713c4d221 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7e5 expref: 9 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.322926:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3e03438200) 00010000:00010000:0.0:1783138123.323062:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783138123.323069:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff000/0x50a9699713c4d221 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7e5 expref: 9 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.323153:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028ff000, rc 0) 00000100:00100000:0.0:1783138123.323220:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+8:18742:x1869755158000512:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 579us (917us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1783138123.323228:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:3.0:1783138123.332248:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138123.334926:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158000768 00000100:00100000:1.0:1783138123.335379:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158000768 00000100:00100000:1.0:1783138123.335462:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:1.0:1783138123.335474:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+8:18742:x1869755158000768:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:1.0:1783138123.335532:0:22744:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138123.335561:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9600/0x50a9699713c4d21a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7de expref: 8 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.335582:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e3f2a999900) 00010000:00010000:1.0:1783138123.335587:0:22744:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783138123.335611:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.336105:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.336120:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783138123.336301:0:22744:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df352cbb reply state 000000004d2c3a18 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.336363:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.336371:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e3f2a999900) 00010000:00010000:1.0:1783138123.336374:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1783138123.336377:0:22744:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783138123.336384:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783138123.336483:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+9:18742:x1869755158000768:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 1010us (4245us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1783138123.336490:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:3.0:1783138123.339280:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.339527:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158001024 00000100:00100000:2.0:1783138123.339537:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158001024 00000100:00100000:2.0:1783138123.339593:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:2.0:1783138123.339603:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+9:18742:x1869755158001024:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1783138123.339922:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+10:18742:x1869755158001024:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 319us (649us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1783138123.339931:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:0.0:1783138123.344678:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.344773:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158001280 00000100:00100000:2.0:1783138123.344783:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158001280 00000100:00100000:2.0:1783138123.344841:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:2.0:1783138123.344867:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+10:18742:x1869755158001280:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1783138123.344891:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138123.344908:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d236 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a7ec expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.344987:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d23d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.344999:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d23d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345010:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d23d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345020:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d244 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345027:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345033:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138123.345154:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783138123.345225:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d23d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345234:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d23d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345239:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d23d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345254:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3098f000 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:2.0:1783138123.345259:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d23d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345266:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d23d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345279:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3e03438200) 00010000:00010000:2.0:1783138123.345282:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138123.345286:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d23d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345293:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d23d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345305:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345310:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d244 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345366:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345371:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3098fe00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:2.0:1783138123.345373:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345379:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d244 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345397:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e3f2a999700) 00010000:00010000:2.0:1783138123.345400:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783138123.345527:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d244 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345536:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d244 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345571:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d236 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7ec expref: 12 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345582:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3e03438200) 00010000:00010000:2.0:1783138123.345584:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783138123.345588:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d236 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7ec expref: 12 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.345597:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f3098fc00, rc 0) 00000100:00100000:2.0:1783138123.345650:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+11:18742:x1869755158001280:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 786us (983us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1783138123.345658:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:1.0:1783138123.349733:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138123.349903:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158001408 00000100:00100000:3.0:1783138123.349913:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158001408 00000100:00100000:3.0:1783138123.349979:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:3.0:1783138123.349988:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+11:18742:x1869755158001408:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1783138123.350011:0:23996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138123.350028:0:23996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9000/0x50a9699713c4d252 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a7f3 expref: -99 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.350664:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.350683:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.350695:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138123.350745:0:23996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783138123.350748:0:23996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783138123.350769:0:23996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.350802:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9000/0x50a9699713c4d252 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7f3 expref: 13 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.350821:0:23996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7f3 expref: 12 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.350831:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e3f2a999900) 00010000:00010000:3.0:1783138123.350835:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783138123.350840:0:23996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b8c00, rc 0) 00000100:00100000:3.0:1783138123.350970:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+12:18742:x1869755158001408:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 982us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138123.350978:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:0.0:1783138123.361259:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138123.361351:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158001536 00000100:00100000:3.0:1783138123.361361:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158001536 00000100:00100000:3.0:1783138123.361423:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:3.0:1783138123.361435:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+12:18742:x1869755158001536:12345-192.168.203.43@tcp:37:lfs.0 00000100:00100000:2.0:1783138123.373291:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+12:18742:x1869755158001536:12345-192.168.203.43@tcp:37:lfs.0 Request processed in 11846us (12031us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.373305:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:1.0:1783138123.376761:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.376857:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158001792 00000100:00100000:2.0:1783138123.376867:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158001792 00000100:00100000:2.0:1783138123.377114:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:2.0:1783138123.377128:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f360b5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+12:18742:x1869755158001792:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1783138123.377396:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f360b5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+13:18742:x1869755158001792:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 270us (645us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1783138123.378086:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1783138123.443528:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.443600:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158001920 00000100:00100000:2.0:1783138123.443610:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158001920 00000100:00100000:2.0:1783138123.443791:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:2.0:1783138123.443911:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+11:18748:x1869755158001920:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1783138123.443932:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138123.443954:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d260 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a7fa expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.444015:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d267 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.444031:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d267 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.444042:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d267 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.444066:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d26e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.444075:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d26e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.444082:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d26e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444525:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9000/0x50a9699713c4d275 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444533:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9000/0x50a9699713c4d275 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444538:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9000/0x50a9699713c4d275 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138123.444581:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783138123.444584:0:22743:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783138123.444613:0:22743:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9000/0x50a9699713c4d275 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444622:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d267 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444628:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d267 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444635:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d267 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444640:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3098fe00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:3.0:1783138123.444644:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d267 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444651:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d267 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444662:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3e03438200) 00010000:00010000:3.0:1783138123.444664:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138123.444668:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444675:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fe00/0x50a9699713c4d267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444688:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d26e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444704:0:22743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d26e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444709:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d26e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444713:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3098f000 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:3.0:1783138123.444716:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d26e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444722:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d26e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444730:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e3f2a999700) 00010000:00010000:3.0:1783138123.444732:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138123.444735:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d26e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444740:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f000/0x50a9699713c4d26e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444767:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d260 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7fa expref: 13 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444780:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9000/0x50a9699713c4d275 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7fa expref: 12 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.444788:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e3f2a999900) 00010000:00010000:3.0:1783138123.444790:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783138123.444798:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b9000, rc 0) 00000100:00100000:3.0:1783138123.445242:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+12:18748:x1869755158001920:12345-192.168.203.43@tcp:101:bash.0 Request processed in 1329us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138123.445253:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:1.0:1783138123.449523:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.449608:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158002048 00000100:00100000:2.0:1783138123.449728:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158002048 00000100:00100000:2.0:1783138123.449828:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1783138123.449839:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:18748:x1869755158002048:12345-192.168.203.43@tcp:900:bash.0 00000100:00100000:2.0:1783138123.449929:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:18748:x1869755158002048:12345-192.168.203.43@tcp:900:bash.0 Request processed in 91us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.449945:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1783138123.452723:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.455434:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158002304 00000100:00100000:2.0:1783138123.455451:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158002304 00000100:00100000:2.0:1783138123.455534:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:2.0:1783138123.455545:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+12:18748:x1869755158002304:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1783138123.455570:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138123.455591:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f800/0x50a9699713c4d27c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a801 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.455713:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.455727:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7f3 expref: 12 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.455736:0:22744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.455781:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7f3 expref: 12 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.455796:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7f3 expref: 12 pid: 23996 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138123.455838:0:22744:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22744:1869755175947776:192.168.203.43@tcp:104: 00000100:00100000:2.0:1783138123.455939:0:22744:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f05aa03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138123.462076:0:22744:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22744:1869755175947776:192.168.203.43@tcp:104: 00010000:00010000:2.0:1783138123.462110:0:22744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138123.462553:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138123.463611:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158002432 00000100:00100000:0.0:1783138123.463623:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158002432 00010000:00010000:0.0:1783138123.463665:0:22729:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7f3 expref: 13 pid: 23996 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138123.463731:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:0.0:1783138123.463741:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f870a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+13:2403:x1869755158002432:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783138123.463756:0:22729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138123.463764:0:22729:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7f3 expref: 13 pid: 23996 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.463776:0:22729:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7f3 expref: 13 pid: 23996 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.463799:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8c00/0x50a9699713c4d259 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a7f3 expref: 13 pid: 23996 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.463816:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e3f2a999900) 00010000:00010000:0.0:1783138123.463821:0:22729:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.463831:0:22729:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.463840:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.463869:0:22729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138123.463939:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f870a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+12:2403:x1869755158002432:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 198us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138123.463948:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00010000:00010000:1.0:1783138123.464084:0:22744:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.464092:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.464145:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.464155:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.464163:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.470482:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d291 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.470509:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d291 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.470521:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d291 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138123.470535:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783138123.470567:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.471528:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.471535:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.471541:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3098fc00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:1.0:1783138123.471545:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.472070:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.472089:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e3f2a999900) 00010000:00010000:1.0:1783138123.472092:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138123.472097:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.472102:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d283 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783138123.472123:0:22744:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009abb5492 reply state 00000000c9c9643c transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.472134:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.472140:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e3e03438900) 00010000:00010000:1.0:1783138123.472141:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783138123.472145:0:22744:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783138123.472194:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f800/0x50a9699713c4d27c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a801 expref: 15 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.472208:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d291 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a801 expref: 14 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.472214:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:1.0:1783138123.472216:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783138123.472218:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e041f9400, rc 0) 00000100:00100000:1.0:1783138123.472302:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+15:18748:x1869755158002304:12345-192.168.203.43@tcp:101:bash.0 Request processed in 16758us (19588us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1783138123.472334:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:2.0:1783138123.498664:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138123.498757:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158002560 00000100:00100000:1.0:1783138123.498767:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158002560 00000100:00100000:1.0:1783138123.498898:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:1.0:1783138123.498911:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0256b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+15:18748:x1869755158002560:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1783138123.499056:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138123.499081:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8a00/0x50a9699713c4d29f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a808 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.499154:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.499170:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.499181:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783138123.499235:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783138123.499240:0:22742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783138123.499260:0:22742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.499271:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.499296:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8a00/0x50a9699713c4d29f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a808 expref: 17 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.499366:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a808 expref: 16 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.499375:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:1.0:1783138123.499378:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783138123.499382:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e041f9a00, rc 0) 00000100:00100000:1.0:1783138123.499491:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0256b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+16:18748:x1869755158002560:12345-192.168.203.43@tcp:101:bash.0 Request processed in 583us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138123.499499:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:0.0:1783138123.504857:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.505473:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158002816 00000100:00100000:2.0:1783138123.505484:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158002816 00000100:00100000:2.0:1783138123.505593:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1783138123.505604:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3632d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+16:18748:x1869755158002816:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:2.0:1783138123.505945:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3632d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+17:18748:x1869755158002816:12345-192.168.203.43@tcp:35:bash.0 Request processed in 342us (1097us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1783138123.505953:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1783138123.544271:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.544411:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158002944 00000100:00100000:2.0:1783138123.544422:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158002944 00000100:00100000:2.0:1783138123.544485:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 160 00000100:00100000:2.0:1783138123.544494:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+11:18105:x1869755158002944:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138123.544510:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138123.544526:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f3098f000/0x50a9699713c4d2ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x40dea3941757a80f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.544555:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f3098f000/0x50a9699713c4d2ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a80f expref: 12 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.544585:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f3098f000/0x50a9699713c4d2ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a80f expref: 12 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.544594:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f3098f000, rc 0) 00000100:00100000:2.0:1783138123.544660:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+12:18105:x1869755158002944:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 165us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.544666:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 160 00000100:00100000:0.0:1783138123.550005:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138123.550168:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158003072 00000100:00100000:1.0:1783138123.550181:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158003072 00000100:00100000:1.0:1783138123.550255:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00100000:1.0:1783138123.550266:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+12:18105:x1869755158003072:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783138123.550505:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+12:18105:x1869755158003072:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 240us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138123.550514:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00100000:0.0:1783138123.556774:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138123.556961:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158003200 00000100:00100000:1.0:1783138123.556970:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158003200 00000100:00100000:1.0:1783138123.557031:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00100000:1.0:1783138123.557040:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+12:18105:x1869755158003200:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138123.557194:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+12:18105:x1869755158003200:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 153us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138123.557203:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00100000:3.0:1783138123.576779:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.577359:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158003328 00000100:00100000:2.0:1783138123.577369:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158003328 00000100:00100000:2.0:1783138123.577432:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 163 00000100:00100000:2.0:1783138123.577443:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+12:18105:x1869755158003328:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783138123.577459:0:22737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138123.577477:0:22737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e3f3098fe00/0x50a9699713c4d2b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x40dea3941757a816 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.577515:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e3f3098fe00/0x50a9699713c4d2b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a816 expref: 13 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.577526:0:22737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e3f3098fe00/0x50a9699713c4d2b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a816 expref: 13 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.577535:0:22737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f3098fe00, rc 0) 00000100:00100000:2.0:1783138123.577594:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e64806b-c006-4a0c-9437-03f90192be80+13:18105:x1869755158003328:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 154us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.577602:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 163 00010000:00010000:0.0:1783138123.578288:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138123.587162:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.587349:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158003456 00000100:00100000:2.0:1783138123.587372:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158003456 00000100:00100000:2.0:1783138123.587430:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 164 00000100:00100000:2.0:1783138123.587441:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f343a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+13:18105:x1869755158003456:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783138123.587610:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f343a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+13:18105:x1869755158003456:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 170us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.588170:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 164 00000100:00100000:0.0:1783138123.590439:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138123.590961:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158003584 00000100:00100000:1.0:1783138123.590990:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158003584 00000100:00100000:1.0:1783138123.591066:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:1.0:1783138123.591078:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+13:18105:x1869755158003584:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783138123.591240:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e64806b-c006-4a0c-9437-03f90192be80+13:18105:x1869755158003584:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 163us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138123.591248:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:1.0:1783138123.615353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138123.615488:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158003840 00000100:00100000:3.0:1783138123.615500:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158003840 00000100:00100000:3.0:1783138123.615566:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:3.0:1783138123.615575:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+17:18760:x1869755158003840:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1783138123.615600:0:23996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138123.615620:0:23996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d2bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a81d expref: -99 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138123.615758:0:23996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783138123.615894:0:23996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d2bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a81d expref: 19 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.615910:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e3e03438200) 00010000:00010000:3.0:1783138123.615913:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783138123.615918:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d2bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a81d expref: 19 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.615932:0:23996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b8200, rc 0) 00000100:00100000:3.0:1783138123.616237:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+18:18760:x1869755158003840:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 661us (934us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1783138123.616245:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:0.0:1783138123.621260:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138123.621363:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158004096 00000100:00100000:3.0:1783138123.621386:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158004096 00000100:00100000:3.0:1783138123.621442:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1783138123.621452:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+18:18760:x1869755158004096:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1783138123.622001:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+19:18760:x1869755158004096:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 546us (747us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1783138123.622012:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:0.0:1783138123.661807:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138123.662082:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158004352 00000100:00100000:3.0:1783138123.662091:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158004352 00000100:00100000:3.0:1783138123.662153:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:3.0:1783138123.662163:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+19:18763:x1869755158004352:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1783138123.662189:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138123.662209:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d2c9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a824 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.662357:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d2d0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.662373:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d2d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.662384:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d2d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138123.662396:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783138123.662513:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d2c9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a824 expref: 22 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.662531:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d2d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a824 expref: 21 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.662556:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:3.0:1783138123.662559:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783138123.662563:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b9a00, rc 0) 00000100:00100000:3.0:1783138123.662620:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+21:18763:x1869755158004352:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 457us (822us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1783138123.662640:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:1.0:1783138123.666383:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138123.666429:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138123.666524:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158004608 00000100:00100000:0.0:1783138123.666533:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158004608 00000100:00100000:0.0:1783138123.666595:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:0.0:1783138123.666605:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f872d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+21:2402:x1869755158004608:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783138123.666621:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138123.666657:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9a00/0x50a9699713c4d2d0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a824 expref: 21 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138123.666684:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:0.0:1783138123.666689:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138123.666742:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f872d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+20:2402:x1869755158004608:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 139us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138123.666750:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1783138123.667349:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158004480 00000100:00100000:2.0:1783138123.667355:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158004480 00000100:00100000:2.0:1783138123.667391:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:2.0:1783138123.667398:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+20:18763:x1869755158004480:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1783138123.667461:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d2de lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.667476:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d2de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.667487:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d2de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.667524:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d2de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.667531:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d2de lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.667537:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d2de lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.667543:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3098f400 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:2.0:1783138123.667548:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d2de lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.667571:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d2de lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.667581:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:2.0:1783138123.667583:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783138123.667587:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d2de lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138123.667593:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098f400/0x50a9699713c4d2de lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138123.668079:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+20:18763:x1869755158004480:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 273us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138123.668091:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1783138123.671602:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.671687:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158004864 00000100:00100000:2.0:1783138123.671697:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158004864 00000100:00100000:2.0:1783138123.671757:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1783138123.671767:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+20:18763:x1869755158004864:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1783138123.672063:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+21:18763:x1869755158004864:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 296us (468us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1783138123.672072:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000040:00080000:2.0:1783138123.901559:0:22776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783138123.952218:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138123.952552:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158005120 00000100:00100000:3.0:1783138123.952562:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158005120 00000100:00100000:3.0:1783138123.952637:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:3.0:1783138123.952649:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+21:18794:x1869755158005120:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:3.0:1783138123.952681:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138123.952701:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d2e5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a82b expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.952812:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9c00/0x50a9699713c4d2ec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.952826:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9c00/0x50a9699713c4d2ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.952836:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9c00/0x50a9699713c4d2ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138123.952848:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783138123.952982:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d2e5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a82b expref: 24 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.953022:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9c00/0x50a9699713c4d2ec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a82b expref: 23 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138123.953031:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:3.0:1783138123.953034:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783138123.953037:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b9c00, rc 0) 00000100:00100000:3.0:1783138123.953177:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+23:18794:x1869755158005120:12345-192.168.203.43@tcp:101:cat.0 Request processed in 530us (967us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1783138123.953185:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:0.0:1783138123.958380:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138123.958806:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158005248 00000100:00100000:1.0:1783138123.958815:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158005248 00000100:00100000:1.0:1783138123.958877:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:1.0:1783138123.958887:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+23:2403:x1869755158005248:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783138123.958903:0:22729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138123.958938:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9c00/0x50a9699713c4d2ec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a82b expref: 23 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138123.958958:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:1.0:1783138123.958963:0:22729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138123.959033:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+22:2403:x1869755158005248:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 147us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138123.959049:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:3.0:1783138123.960304:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138123.960641:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158005504 00000100:00100000:2.0:1783138123.960650:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158005504 00000100:00100000:2.0:1783138123.960710:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1783138123.960720:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+22:18794:x1869755158005504:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:2.0:1783138123.961026:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+23:18794:x1869755158005504:12345-192.168.203.43@tcp:35:cat.0 Request processed in 305us (728us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1783138123.961059:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1783138124.038635:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138124.038818:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158005760 00000100:00100000:1.0:1783138124.038828:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158005760 00000100:00100000:1.0:1783138124.038906:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00080000:0.0:1783138124.039060:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783138124.039139:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e02569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+23:18800:x1869755158005760:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:1.0:1783138124.039171:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138124.039196:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8600/0x50a9699713c4d2fa lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a832 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.039362:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9200/0x50a9699713c4d301 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.039379:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d291 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a801 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.039388:0:22744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a808 expref: 24 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.039397:0:22744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9200/0x50a9699713c4d301 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.039434:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a808 expref: 24 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.039476:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a808 expref: 24 pid: 22742 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138124.039490:0:22744:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f870380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22744:1869755175947904:192.168.203.43@tcp:104: 00010000:00010000:1.0:1783138124.039814:0:22744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d291 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a801 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.039825:0:22744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d291 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a801 expref: 24 pid: 22744 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138124.039844:0:22744:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f870e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22744:1869755175948032:192.168.203.43@tcp:104: 00000100:00100000:1.0:1783138124.039872:0:22744:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f09860d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783138124.047506:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138124.047597:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138124.047664:0:22744:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f870380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22744:1869755175947904:192.168.203.43@tcp:104: 00000100:00100000:1.0:1783138124.047688:0:22744:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f870e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22744:1869755175948032:192.168.203.43@tcp:104: 00010000:00010000:1.0:1783138124.047715:0:22744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9200/0x50a9699713c4d301 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138124.048437:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158005888 00000100:00100000:3.0:1783138124.048447:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158005888 00010000:00010000:3.0:1783138124.048487:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a808 expref: 25 pid: 22742 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138124.048562:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158006016 00000100:00100000:3.0:1783138124.048566:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158006016 00010000:00010000:3.0:1783138124.048579:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d291 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a801 expref: 26 pid: 22744 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138124.048614:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1783138124.048640:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+26:2402:x1869755158005888:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783138124.048656:0:22729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138124.048663:0:22729:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a808 expref: 26 pid: 22742 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.048684:0:22729:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a808 expref: 26 pid: 22742 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.048706:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d2a6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a808 expref: 26 pid: 22742 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.048724:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:1.0:1783138124.048730:0:22729:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9200/0x50a9699713c4d301 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.048739:0:22729:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9200/0x50a9699713c4d301 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.048760:0:22729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138124.048818:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+25:2402:x1869755158005888:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 194us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.048826:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1783138124.048852:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1783138124.048859:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2c2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+24:2402:x1869755158006016:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783138124.048867:0:22729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138124.048872:0:22729:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d291 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a801 expref: 24 pid: 22744 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.048881:0:22729:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d291 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a801 expref: 24 pid: 22744 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.048892:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d291 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a801 expref: 24 pid: 22744 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.048901:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:1.0:1783138124.048905:0:22729:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9200/0x50a9699713c4d301 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.048913:0:22729:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9200/0x50a9699713c4d301 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.048920:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9200/0x50a9699713c4d301 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.048954:0:22729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138124.048978:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2c2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+23:2402:x1869755158006016:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 120us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.048986:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00010000:00010000:2.0:1783138124.049207:0:22744:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9200/0x50a9699713c4d301 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138124.049226:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9200/0x50a9699713c4d301 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783138124.049245:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783138124.049419:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8600/0x50a9699713c4d2fa lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a832 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138124.049434:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9200/0x50a9699713c4d301 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a832 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138124.049442:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:2.0:1783138124.049445:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783138124.049447:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e041f9200, rc 0) 00000100:00100000:2.0:1783138124.049481:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e02569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+23:18800:x1869755158005760:12345-192.168.203.43@tcp:101:dd.0 Request processed in 10554us (10857us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1783138124.049488:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:0.0:1783138124.054511:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138124.054587:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158006144 00000100:00100000:3.0:1783138124.054595:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158006144 00000100:00100000:3.0:1783138124.054647:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:3.0:1783138124.054657:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+23:18800:x1869755158006144:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:3.0:1783138124.054689:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138124.054709:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d30f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a839 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.054755:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d316 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.054770:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d316 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.054781:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d316 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.054902:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d30f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a839 expref: 25 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.054919:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d316 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a839 expref: 24 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.054935:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:3.0:1783138124.054938:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783138124.054941:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b8400, rc 0) 00000100:00100000:3.0:1783138124.055004:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+24:18800:x1869755158006144:12345-192.168.203.43@tcp:101:dd.0 Request processed in 349us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.055012:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:2.0:1783138124.062524:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138124.062679:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158006400 00000100:00100000:3.0:1783138124.062689:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158006400 00000100:00100000:3.0:1783138124.062751:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:3.0:1783138124.062760:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0256ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+24:18800:x1869755158006400:12345-192.168.203.43@tcp:36:dd.0 00010000:00010000:3.0:1783138124.062987:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.063020:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.063031:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783138124.063302:0:23996:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1783138124.063360:0:23996:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000431146cc reply state 0000000094b7b1d0 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.063374:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.063381:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:3.0:1783138124.063383:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783138124.063387:0:23996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783138124.063468:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0256ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+27:18800:x1869755158006400:12345-192.168.203.43@tcp:36:dd.0 Request processed in 708us (953us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1783138124.063476:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000020:00080000:3.0:1783138124.063481:0:23996:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783138124.066587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138124.066661:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158006528 00000100:00100000:3.0:1783138124.066672:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158006528 00000100:00100000:3.0:1783138124.066804:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:3.0:1783138124.066815:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+27:18800:x1869755158006528:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:3.0:1783138124.066888:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138124.066909:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8a00/0x50a9699713c4d324 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a840 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.066964:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8a00/0x50a9699713c4d324 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a840 expref: 28 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.066994:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8a00/0x50a9699713c4d324 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a840 expref: 28 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.067016:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:3.0:1783138124.067019:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783138124.067022:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b8a00, rc 0) 00000100:00100000:3.0:1783138124.067619:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+28:18800:x1869755158006528:12345-192.168.203.43@tcp:101:dd.0 Request processed in 802us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.067628:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:0.0:1783138124.085037:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138124.087016:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158006784 00000100:00100000:2.0:1783138124.087030:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158006784 00000100:00100000:2.0:1783138124.087188:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:2.0:1783138124.087199:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+28:18800:x1869755158006784:12345-192.168.203.43@tcp:103:dd.0 00010000:00010000:2.0:1783138124.087345:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138124.087390:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8a00/0x50a9699713c4d324 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a840 expref: 28 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138124.087411:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:2.0:1783138124.087417:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138124.087489:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+27:18800:x1869755158006784:12345-192.168.203.43@tcp:103:dd.0 Request processed in 291us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138124.087497:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:2.0:1783138124.091716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138124.093008:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158006912 00000100:00100000:1.0:1783138124.093022:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158006912 00000100:00100000:1.0:1783138124.093181:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:1.0:1783138124.093192:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e02568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+27:18800:x1869755158006912:12345-192.168.203.43@tcp:58:dd.0 00010000:00010000:1.0:1783138124.093506:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.093526:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.093538:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783138124.100012:0:22744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783138124.100052:0:22744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1783138124.100287:0:22744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1783138124.100506:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e02568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+27:18800:x1869755158006912:12345-192.168.203.43@tcp:58:dd.0 Request processed in 7309us (8794us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.100518:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:0.0:1783138124.106069:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138124.106285:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158007040 00000100:00100000:3.0:1783138124.106296:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158007040 00000100:00100000:3.0:1783138124.106402:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:3.0:1783138124.106412:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+27:18800:x1869755158007040:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:3.0:1783138124.106432:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138124.106452:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d332 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a847 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.106521:0:22743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.106532:0:22743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d332 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a847 expref: 28 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.106550:0:22743:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.106561:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d332 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a847 expref: 28 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.106578:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:3.0:1783138124.106581:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783138124.106584:0:22743:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d332 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a847 expref: 28 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.106592:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b8200, rc 0) 00000100:00100000:3.0:1783138124.106657:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+28:18800:x1869755158007040:12345-192.168.203.43@tcp:101:dd.0 Request processed in 247us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.106664:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:3.0:1783138124.153951:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175948160:0@lo:400:kworker.0 00000100:00100000:2.0:1783138124.154027:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175948288:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.154035:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138124.154083:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138124.154094:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0287c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175948544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783138124.154107:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869755175948800:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.154129:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138124.154144:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138124.154151:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f0ac9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175949184:0@lo:400:kworker.0 00000100:00100000:2.0:1783138124.154170:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f361d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869755175949312:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.154183:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138124.154200:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138124.154221:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f361d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869755175949824:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.154231:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f361d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869755175949696:0@lo:400:kworker.0 00000100:00100000:2.0:1783138124.154243:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138124.154281:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175949184 00000100:00100000:2.0:1783138124.154288:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175949184 00000100:00100000:1.0:1783138124.154409:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175948544 00000100:00100000:1.0:1783138124.154414:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175948544 00000100:00080000:0.0:1783138124.154547:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783138124.154559:0:23767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175948288 00000100:00100000:0.0:1783138124.154562:0:23767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175948288 00000100:00100000:2.0:1783138124.154619:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783138124.154631:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e03b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3660:x1869755175949184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138124.154686:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e03b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3660:x1869755175949184:12345-0@lo:400:kworker.0 Request processed in 57us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138124.154694:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783138124.154722:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e02568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175948416:0@lo:400:kworker.0 00000100:00100000:2.0:1783138124.154746:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138124.154778:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e02569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175948928:0@lo:400:kworker.0 00000100:00100000:2.0:1783138124.154800:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783138124.154815:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f361d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869755175949440:0@lo:400:kworker.0 00000100:00100000:2.0:1783138124.154839:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175948416 00000100:00100000:2.0:1783138124.154842:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175948416 00000100:00100000:2.0:1783138124.154872:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783138124.154878:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175948416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138124.154913:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175948416:12345-0@lo:400:kworker.0 Request processed in 35us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138124.154919:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783138124.154935:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175948928 00000100:00100000:2.0:1783138124.154938:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175948928 00000100:00100000:1.0:1783138124.159272:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783138124.159303:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0287d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175948544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783138124.159354:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1783138124.159461:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0287d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175948544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 173us (5331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.159488:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783138124.159567:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175948800 00000100:00100000:1.0:1783138124.159574:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175948800 00000100:00100000:1.0:1783138124.159616:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175949312 00000100:00100000:1.0:1783138124.159620:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175949312 00000100:00100000:1.0:1783138124.159633:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175949824 00000100:00100000:1.0:1783138124.159636:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175949824 00000100:00100000:1.0:1783138124.159654:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783138124.159660:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869755175948800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138124.159717:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1869755175948800:12345-0@lo:400:kworker.0 Request processed in 56us (5574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.159724:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783138124.159736:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783138124.159742:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869755175949312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138124.159768:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1869755175949312:12345-0@lo:400:kworker.0 Request processed in 26us (5569us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.159773:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783138124.159784:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783138124.159790:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869755175949824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783138124.159816:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1869755175949824:12345-0@lo:400:kworker.0 Request processed in 27us (5573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.159822:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783138124.168965:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138124.169082:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0287c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175948544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783138124.169593:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f0ac9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175949184:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.169687:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175948160 00000100:00100000:3.0:1783138124.169693:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175948160 00000100:00100000:3.0:1783138124.169739:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783138124.169748:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:3660:x1869755175948160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.169829:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff132a53-abfa-4987-a345-1706880f10ac+24:3660:x1869755175948160:12345-0@lo:400:kworker.0 Request processed in 81us (15797us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.169837:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783138124.169872:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff132a53-abfa-4987-a345-1706880f10ac:3660:1869755175948160:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.169894:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175949696 00000100:00100000:3.0:1783138124.169897:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175949696 00000100:00100000:3.0:1783138124.170198:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783138124.170217:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869755175949696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.170259:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1869755175949696:12345-0@lo:400:kworker.0 Request processed in 53us (15991us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.170265:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783138124.170486:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f361d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1869755175949696:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.170538:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138124.170564:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175949952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783138124.170594:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138124.170624:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e02568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175948416:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.170633:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1783138124.170639:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175948672:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.170661:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138124.170679:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0256aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175949056:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.170700:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138124.170717:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f361d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869755175949568:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.170738:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138124.170752:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175950080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783138124.170783:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138124.170812:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175949952 00000100:00100000:3.0:1783138124.170817:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175949952 00000100:00100000:3.0:1783138124.170835:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175950080 00000100:00100000:3.0:1783138124.170838:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175950080 00000100:00100000:3.0:1783138124.170852:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783138124.170857:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175949952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783138124.170873:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783138124.170907:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175949952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.170913:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783138124.172396:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783138124.172423:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175948288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783138124.172508:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1869755175948288:12345-0@lo:400:kworker.0 Request processed in 97us (18425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.173470:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783138124.173494:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175950080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783138124.173515:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1783138124.173566:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175950080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.173573:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783138124.173644:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175950080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783138124.173663:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0399d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175949952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783138124.173695:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175949440 00000100:00100000:3.0:1783138124.173701:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175949440 00000100:00100000:3.0:1783138124.173742:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175949568 00000100:00100000:3.0:1783138124.173745:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175949568 00000100:00100000:3.0:1783138124.173765:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783138124.173771:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869755175949440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.173807:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1869755175949440:12345-0@lo:400:kworker.0 Request processed in 37us (3269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.173828:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783138124.173839:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783138124.173843:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869755175949568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.173872:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1869755175949568:12345-0@lo:400:kworker.0 Request processed in 28us (3134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.173877:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1783138124.173902:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f361d1880 x1869755175949568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138124.173913:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f361d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1869755175949568:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.173924:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f361d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1869755175949440:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.173972:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175948672 00000100:00100000:3.0:1783138124.173976:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175948672 00000100:00100000:3.0:1783138124.173998:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175949056 00000100:00100000:3.0:1783138124.174001:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175949056 00000100:00100000:3.0:1783138124.174021:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783138124.174026:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175948672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.174071:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1869755175948672:12345-0@lo:400:kworker.0 Request processed in 44us (3408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.174076:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783138124.174087:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783138124.174093:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175949056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.174118:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175949056:12345-0@lo:400:kworker.0 Request processed in 26us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.174123:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783138124.174156:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1869755175948288:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.174167:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1869755175948800:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.174179:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f361d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1869755175949312:0@lo:400:kworker.0 00010000:00080000:3.0:1783138124.174190:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e3f361d1c00 x1869755175949824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783138140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783138124.174199:0:3661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f361d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1869755175949824:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.174225:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1869755175948672:0@lo:400:kworker.0 00000100:00100000:3.0:1783138124.174233:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0256aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175949056:0@lo:400:kworker.0 00000100:00080000:3.0:1783138124.174284:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783138124.174288:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783138124.174290:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783138124.174292:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783138124.176594:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783138124.176621:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175948928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783138124.176790:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1869755175948928:12345-0@lo:400:kworker.0 Request processed in 182us (21987us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138124.176798:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783138124.176972:0:3658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e02569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1869755175948928:0@lo:400:kworker.0 00000100:00100000:0.0:1783138124.179295:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783138124.551005:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138124.551176:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138124.551208:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138124.551244:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138124.551262:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138124.551277:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138124.551292:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138124.551308:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138124.551413:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158007680 00000100:00100000:1.0:1783138124.551422:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158007680 00000100:00100000:1.0:1783138124.551474:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158008192 00000100:00100000:1.0:1783138124.551478:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158008192 00000100:00100000:1.0:1783138124.551491:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158007552 00000100:00100000:1.0:1783138124.551508:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158007552 00000100:00100000:1.0:1783138124.551531:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:1.0:1783138124.551540:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2401:x1869755158007680:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138124.551621:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2401:x1869755158007680:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 81us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.551630:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:1.0:1783138124.551645:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:1.0:1783138124.551652:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2401:x1869755158008192:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138124.551676:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2401:x1869755158008192:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.551682:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:1.0:1783138124.551693:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1783138124.551699:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2401:x1869755158007552:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138124.551736:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2401:x1869755158007552:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 37us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.551743:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:0.0:1783138124.552186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138124.552260:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158007168 00000100:00100000:2.0:1783138124.552265:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158007168 00000100:00100000:2.0:1783138124.552308:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:2.0:1783138124.552348:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+13:2401:x1869755158007168:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1783138124.552387:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e64806b-c006-4a0c-9437-03f90192be80+13:2401:x1869755158007168:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 41us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138124.552393:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:1.0:1783138124.552545:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158008064 00000100:00100000:1.0:1783138124.552549:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158008064 00000100:00100000:1.0:1783138124.552572:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:1.0:1783138124.552578:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2401:x1869755158008064:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138124.552618:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2401:x1869755158008064:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 39us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.552625:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:1.0:1783138124.552644:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158007424 00000100:00100000:1.0:1783138124.552657:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158007424 00000100:00100000:1.0:1783138124.552678:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158007936 00000100:00100000:1.0:1783138124.552681:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158007936 00000100:00100000:1.0:1783138124.552693:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158007296 00000100:00100000:1.0:1783138124.552695:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158007296 00000100:00100000:1.0:1783138124.552705:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158007808 00000100:00100000:1.0:1783138124.552707:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158007808 00000100:00100000:1.0:1783138124.552735:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:1.0:1783138124.552742:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2401:x1869755158007424:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138124.552770:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2401:x1869755158007424:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 29us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.552777:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:1.0:1783138124.552789:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:1.0:1783138124.552795:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2401:x1869755158007936:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138124.552819:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+5:2401:x1869755158007936:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.552825:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:1.0:1783138124.552836:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:1.0:1783138124.552842:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+28:2401:x1869755158007296:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138124.552865:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+28:2401:x1869755158007296:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 23us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.552871:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:1.0:1783138124.552882:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:1.0:1783138124.552888:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+12:2401:x1869755158007808:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1783138124.552941:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:de7fa2be-2332-44b8-b80c-0dcb0b83c02e+12:2401:x1869755158007808:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 50us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.553436:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00080000:3.0:1783138124.553618:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783138124.553625:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783138124.601757:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783138124.921534:0:22776:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1783138124.921553:0:22776:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783138124.921581:0:22776:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1783138124.921590:0:22776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1783138124.921718:0:22776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f361d1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22776:1869755175950208:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783138124.921806:0:22776:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e180780 going to sleep for 11 seconds 00000100:00100000:2.0:1783138124.928471:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138124.929180:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158008320 00000100:00100000:1.0:1783138124.929191:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158008320 00000100:00100000:1.0:1783138124.929257:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:1.0:1783138124.929267:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+29:18801:x1869755158008320:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783138124.929301:0:22744:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783138124.929471:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+29:18801:x1869755158008320:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 204us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.929480:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:0.0:1783138124.930601:0:22776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f361d1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22776:1869755175950208:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783138124.937760:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138124.937844:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158008448 00000100:00100000:3.0:1783138124.937854:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158008448 00000100:00100000:3.0:1783138124.937917:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:3.0:1783138124.937937:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+28:18801:x1869755158008448:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783138124.938008:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d339 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938025:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d339 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938046:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d339 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938102:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d340 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938112:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d340 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938118:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d340 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938142:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d347 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938151:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d347 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938157:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d347 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138124.938206:0:23996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783138124.938211:0:23996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783138124.938228:0:23996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d347 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938240:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d339 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938247:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d339 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938447:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d339 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938464:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8000 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:3.0:1783138124.938468:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d339 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938476:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d339 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938489:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e3f3e1c9600) 00010000:00010000:3.0:1783138124.938492:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138124.938497:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d339 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938502:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d339 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938515:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d340 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938521:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d340 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938527:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d340 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938532:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8e00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:3.0:1783138124.938535:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d340 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938541:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d340 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938559:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9e3e02544b00) 00010000:00010000:3.0:1783138124.938562:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138124.938565:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d340 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938571:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d340 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938584:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d347 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938589:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d347 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938594:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d347 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938598:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9400 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:3.0:1783138124.938600:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d347 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938604:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d347 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938610:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:3.0:1783138124.938612:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138124.938614:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d347 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.938619:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d347 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138124.938756:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+28:18801:x1869755158008448:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 820us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.938764:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:2.0:1783138124.946346:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138124.946476:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158008704 00000100:00100000:3.0:1783138124.946485:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158008704 00000100:00100000:3.0:1783138124.946543:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:3.0:1783138124.946553:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+28:18801:x1869755158008704:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783138124.946576:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138124.946593:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d34e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a84e expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946696:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d355 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946712:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d355 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946723:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d355 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138124.946736:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783138124.946810:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d355 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946818:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d355 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946823:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d355 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946845:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8e00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:3.0:1783138124.946849:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d355 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946857:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d355 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946870:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:3.0:1783138124.946873:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783138124.946878:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d355 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946885:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d355 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946936:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d34e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a84e expref: 30 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946946:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e3f3e1c9600) 00010000:00010000:3.0:1783138124.946949:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783138124.946953:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d34e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a84e expref: 30 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.946964:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b9400, rc 0) 00000100:00100000:3.0:1783138124.947023:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+29:18801:x1869755158008704:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 472us (686us total) trans 12884901907 rc 301/301 00000100:00100000:3.0:1783138124.947031:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:2.0:1783138124.959077:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138124.959163:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158008832 00000100:00100000:3.0:1783138124.959185:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158008832 00000100:00100000:3.0:1783138124.959245:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:3.0:1783138124.959263:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+29:18801:x1869755158008832:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783138124.959300:0:23996:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783138124.959465:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+29:18801:x1869755158008832:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 211us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138124.959474:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:2.0:1783138124.963653:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138124.963740:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158009088 00000100:00100000:3.0:1783138124.963752:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158009088 00000100:00100000:3.0:1783138124.963812:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:3.0:1783138124.963822:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+29:18801:x1869755158009088:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783138124.963841:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138124.963861:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d363 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a855 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783138124.964248:0:22742:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:3.0:1783138124.964269:0:22742:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:3.0:1783138124.964290:0:22742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1783138124.964632:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d36a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.964647:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d36a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.964657:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d36a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.964715:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d363 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a855 expref: 32 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.964753:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d36a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a855 expref: 31 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.964761:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e02544b00) 00010000:00010000:3.0:1783138124.964764:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783138124.964768:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b8e00, rc 0) 00000100:00100000:3.0:1783138124.964832:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+31:18801:x1869755158009088:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1010us (1186us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1783138124.964841:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:2.0:1783138124.971204:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138124.971288:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158009344 00000100:00100000:3.0:1783138124.971298:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158009344 00000100:00100000:3.0:1783138124.971379:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:3.0:1783138124.971391:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+31:18801:x1869755158009344:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783138124.971455:0:23996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138124.971478:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d36a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a855 expref: 31 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971496:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e02544b00) 00010000:00010000:3.0:1783138124.971505:0:23996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783138124.971525:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d378 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971535:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d378 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971544:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d378 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971571:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d37f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd4d6b423 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971579:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d37f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd4d6b423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971585:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d37f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd4d6b423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971632:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d378 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971640:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d378 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971645:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d378 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971651:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9400 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:3.0:1783138124.971654:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d378 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971661:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d378 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971669:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e3f2a999900) 00010000:00010000:3.0:1783138124.971672:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138124.971676:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d378 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971682:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d378 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971697:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d37f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd4d6b423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971703:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d37f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd4d6b423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971710:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d37f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd4d6b423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971715:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8000 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:3.0:1783138124.971718:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d37f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd4d6b423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971724:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d37f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd4d6b423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971732:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xd4d6b423 (ffff9e3e02544d00) 00010000:00010000:3.0:1783138124.971735:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783138124.971738:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d37f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd4d6b423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.971742:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d37f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd4d6b423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138124.971825:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+30:18801:x1869755158009344:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 436us (630us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783138124.971832:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:2.0:1783138124.974746:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138124.974838:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158009472 00000100:00100000:1.0:1783138124.974847:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158009472 00000100:00100000:1.0:1783138124.974904:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:1.0:1783138124.974914:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+30:18801:x1869755158009472:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783138124.974942:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138124.974962:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d386 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a85c expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.974996:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8600/0x50a9699713c4d38d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.975007:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8600/0x50a9699713c4d38d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.975017:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8600/0x50a9699713c4d38d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.975138:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d386 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a85c expref: 32 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.975167:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8600/0x50a9699713c4d38d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a85c expref: 31 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.975176:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e03438300) 00010000:00010000:1.0:1783138124.975179:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783138124.975182:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e041f8600, rc 0) 00000100:00100000:1.0:1783138124.975242:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+31:18801:x1869755158009472:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 329us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.975258:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:2.0:1783138124.980105:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138124.980377:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158009728 00000100:00100000:3.0:1783138124.980388:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158009728 00000100:00100000:3.0:1783138124.980435:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:3.0:1783138124.980461:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+31:18801:x1869755158009728:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783138124.980547:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.980565:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.980576:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783138124.980749:0:23996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1783138124.980892:0:23996:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786714444972ns, next at 787714442264ns, rc = 0 00000004:00010000:3.0:1783138124.981096:0:23996:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000996591ef reply state 0000000028129628 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.981112:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138124.981120:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e03438300) 00010000:00010000:3.0:1783138124.981122:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783138124.981126:0:23996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783138124.981863:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+33:18801:x1869755158009728:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1398us (1761us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1783138124.981873:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:2.0:1783138124.988433:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138124.988717:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158009856 00000100:00100000:1.0:1783138124.988729:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158009856 00000100:00100000:1.0:1783138124.988788:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1783138124.988798:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+33:18801:x1869755158009856:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783138124.988820:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783138124.988839:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d39b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a863 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.988894:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d39b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a863 expref: 34 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.988909:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d39b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a863 expref: 34 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138124.989265:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e03438300) 00010000:00010000:1.0:1783138124.989270:0:22744:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783138124.989287:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e041f9a00, rc 0) 00000100:00100000:1.0:1783138124.989607:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+34:18801:x1869755158009856:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 808us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138124.989614:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1783138124.994665:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138124.994796:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158009984 00000100:00100000:2.0:1783138124.994806:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158009984 00000100:00100000:2.0:1783138124.994914:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1783138124.994931:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f34552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2402:x1869755158009984:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783138124.995203:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f34552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2402:x1869755158009984:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 273us (548us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1783138124.995211:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1783138124.999688:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138125.006662:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158010240 00000100:00100000:0.0:1783138125.006678:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158010240 00000100:00100000:0.0:1783138125.006757:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1783138125.006768:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+34:18801:x1869755158010240:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783138125.007013:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+35:18801:x1869755158010240:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 245us (7332us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1783138125.007021:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1783138125.026751:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138125.026828:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158010496 00000100:00100000:0.0:1783138125.026854:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158010496 00000100:00100000:0.0:1783138125.027017:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1783138125.027028:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+35:18801:x1869755158010496:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783138125.027155:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+35:18801:x1869755158010496:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 129us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138125.027163:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:1.0:1783138125.033066:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138125.033186:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158010624 00000100:00100000:3.0:1783138125.033197:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158010624 00000100:00100000:3.0:1783138125.033617:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:3.0:1783138125.033631:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+35:18801:x1869755158010624:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783138125.033655:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783138125.033676:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d3a2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a86a expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.033744:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3a9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.033773:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.033785:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783138125.033830:0:22742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783138125.033848:0:22742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.033873:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d3a2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a86a expref: 37 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.034597:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a86a expref: 36 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.034615:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e03438300) 00010000:00010000:3.0:1783138125.034618:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783138125.034621:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028b8e00, rc 0) 00000100:00100000:2.0:1783138125.034754:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+36:18801:x1869755158010624:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1122us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138125.034775:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:3.0:1783138125.039952:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138125.040026:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158010752 00000100:00100000:0.0:1783138125.040045:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158010752 00000100:00100000:0.0:1783138125.040101:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:0.0:1783138125.040111:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+6:2402:x1869755158010752:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783138125.040128:0:24250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138125.040148:0:24250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006979fcf1/0x50a9699713c4d3b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a871 expref: -99 pid: 24250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783138125.040173:0:24250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a48874c, blocks: 0x0 00010000:00010000:0.0:1783138125.040193:0:24250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1783138125.040198:0:24250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138125.040207:0:24250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006979fcf1/0x50a9699713c4d3b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a871 expref: 7 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.040228:0:24250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006979fcf1/0x50a9699713c4d3b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a871 expref: 7 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.040241:0:24250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028ff600, rc 0) 00000100:00100000:0.0:1783138125.040298:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:2402:x1869755158010752:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 189us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138125.040358:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:3.0:1783138125.050121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138125.050242:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158011008 00000100:00100000:2.0:1783138125.050261:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158011008 00000100:00100000:2.0:1783138125.050370:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1783138125.050380:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+36:18801:x1869755158011008:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783138125.050499:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+36:18801:x1869755158011008:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 120us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138125.050507:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1783138125.056273:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138125.057101:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158011136 00000100:00100000:3.0:1783138125.057112:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158011136 00000100:00100000:3.0:1783138125.057183:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:3.0:1783138125.057193:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+36:18801:x1869755158011136:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783138125.061012:0:22722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1783138125.061028:0:22722:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1783138125.061127:0:22722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1783138125.061202:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061216:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061224:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061231:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028fe600 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:1.0:1783138125.061236:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061243:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061261:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e3f2a999700) 00010000:00010000:1.0:1783138125.061265:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138125.061269:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061276:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d1db lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061362:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061370:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061377:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061382:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028ffa00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:1.0:1783138125.061385:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061390:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061399:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e3f2a999900) 00010000:00010000:1.0:1783138125.061401:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138125.061404:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061409:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d1e2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061423:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061429:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061435:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061457:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f8e00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:1.0:1783138125.061460:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061466:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061475:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e3e03438900) 00010000:00010000:1.0:1783138125.061478:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138125.061481:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061728:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f8e00/0x50a9699713c4d28a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061747:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061753:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061760:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061766:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8600 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:1.0:1783138125.061769:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138125.061772:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f361d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175950336:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1783138125.061779:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061800:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:1.0:1783138125.061803:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783138125.061806:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061812:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8600/0x50a9699713c4d31d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061826:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061833:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061840:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138125.061842:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783138125.061850:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8000 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:1.0:1783138125.061853:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061859:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061868:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e03438300) 00010000:00010000:1.0:1783138125.061871:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783138125.061874:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.061879:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8000/0x50a9699713c4d394 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138125.061985:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175950336 00000100:00100000:2.0:1783138125.061994:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175950336 00000100:00100000:2.0:1783138125.062054:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783138125.062063:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1869755175950336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783138125.062182:0:24248:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783138125.062185:0:24248:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1783138125.062187:0:24248:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783138125.062190:0:24248:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1783138124 -> 1783138124 00002000:00010000:2.0:1783138125.062193:0:24248:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1783138125.062236:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1869755175950336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 174us (395us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1783138125.062245:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:2.0:1783138125.062285:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e3f361d0000/2, rc 0, transno 12884901892 00000100:00100000:2.0:1783138125.062291:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f361d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1869755175950336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783138125.062633:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+15:18801:x1869755158011136:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 5439us (6367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138125.062641:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00010000:00010000:3.0:1783138125.067114:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.067148:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.067156:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.067163:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9e00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:3.0:1783138125.067168:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.067177:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.067194:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e3f2a999900) 00010000:00010000:3.0:1783138125.067198:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1783138125.067204:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.067211:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9e00/0x50a9699713c4d22f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138125.067254:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138125.071500:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158011264 00000100:00100000:0.0:1783138125.071515:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158011264 00000100:00100000:0.0:1783138125.071586:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:0.0:1783138125.071597:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:2402:x1869755158011264:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783138125.071715:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:2402:x1869755158011264:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 119us (4465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138125.071722:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:2.0:1783138125.077159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138125.077239:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158011520 00000100:00100000:3.0:1783138125.077249:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158011520 00000100:00100000:3.0:1783138125.077308:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:3.0:1783138125.077346:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f361d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+15:18801:x1869755158011520:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783138125.077398:0:23996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783138125.077428:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3a9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a86a expref: 15 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.077465:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e03438300) 00010000:00010000:3.0:1783138125.077470:0:23996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783138125.077498:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d3b7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.077511:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d3b7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.077519:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d3b7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783138125.077651:0:23996:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ae77c19 reply state 000000006577287b transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d3b7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.077664:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b9400/0x50a9699713c4d3b7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.077679:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e03438300) 00010000:00010000:3.0:1783138125.077682:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783138125.077684:0:23996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783138125.077779:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f361d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+16:18801:x1869755158011520:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 434us (629us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1783138125.077787:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:1.0:1783138125.086097:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138125.086186:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158011648 00000100:00100000:2.0:1783138125.086208:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158011648 00000100:00100000:2.0:1783138125.086263:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1783138125.086274:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:18801:x1869755158011648:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783138125.086292:0:24248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783138125.086308:0:24248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a878 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.086370:0:24248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006979fcf1/0x50a9699713c4d3b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a871 expref: 8 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.086380:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138125.086384:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783138125.086390:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 8 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.086424:0:24248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006979fcf1/0x50a9699713c4d3b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a871 expref: 8 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.086448:0:24248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006979fcf1/0x50a9699713c4d3b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a871 expref: 8 pid: 24250 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138125.086463:0:24248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24248:1869755175950464:192.168.203.43@tcp:104: 00000100:00100000:2.0:1783138125.086558:0:24248:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e180000 going to sleep for 11 seconds 00000100:00100000:2.0:1783138125.089755:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138125.089859:0:24248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24248:1869755175950464:192.168.203.43@tcp:104: 00010000:00010000:3.0:1783138125.089904:0:24248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 8 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.089926:0:24248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3f3098fc00, rc 0) 00000100:00100000:3.0:1783138125.089999:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+8:18801:x1869755158011648:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 3726us (3910us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138125.090008:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:0.0:1783138125.095141:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158011776 00000100:00100000:0.0:1783138125.095160:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158011776 00010000:00010000:0.0:1783138125.095215:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006979fcf1/0x50a9699713c4d3b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a871 expref: 8 pid: 24250 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138125.095252:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1783138125.095262:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2a986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+8:2403:x1869755158011776:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783138125.095277:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138125.095295:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006979fcf1/0x50a9699713c4d3b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a871 expref: 8 pid: 24250 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.095309:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006979fcf1/0x50a9699713c4d3b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a871 expref: 8 pid: 24250 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.095378:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006979fcf1/0x50a9699713c4d3b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a871 expref: 8 pid: 24250 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.095394:0:22728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138125.095398:0:22728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138125.095405:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 7 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.095415:0:22728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 7 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.095466:0:22728:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 7 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138125.095480:0:22728:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0399dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22728:1869755175950592:192.168.203.43@tcp:105: 00000100:00100000:0.0:1783138125.095567:0:22728:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a9516c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783138125.102372:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138125.102651:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158011904 00000100:00100000:3.0:1783138125.102661:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158011904 00000100:00100000:3.0:1783138125.102724:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:3.0:1783138125.102734:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+8:2403:x1869755158011904:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783138125.102890:0:24249:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783138125.102906:0:24249:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1783138124 00002000:00010000:3.0:1783138125.102909:0:24249:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1783138123 00002000:00010000:3.0:1783138125.102911:0:24249:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1783138124 -> 1783138124 00002000:00010000:3.0:1783138125.102914:0:24249:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1783138125.102978:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+9:2403:x1869755158011904:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 245us (616us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1783138125.102987:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:0.0:1783138125.103262:0:22728:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0399dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22728:1869755175950592:192.168.203.43@tcp:105: 00010000:00010000:0.0:1783138125.103283:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138125.103307:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2a986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+8:2403:x1869755158011776:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 8047us (13562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138125.103345:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:3.0:1783138125.109083:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138125.109305:0:24746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158012032 00000100:00100000:0.0:1783138125.109547:0:24746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158012032 00000100:00100000:1.0:1783138125.117830:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:1.0:1783138125.117845:0:24746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+8:2402:x1869755158012032:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783138125.117891:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.118058:0:24746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 8 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.118068:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783138125.118072:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783138125.118077:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.118113:0:24746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 8 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.118126:0:24746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 8 pid: 24248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138125.118142:0:24746:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f873b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24746:1869755175950720:192.168.203.43@tcp:104: 00000100:00100000:1.0:1783138125.118249:0:24746:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f09860840 going to sleep for 11 seconds 00000100:00100000:1.0:1783138125.126529:0:24746:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f873b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24746:1869755175950720:192.168.203.43@tcp:104: 00010000:00010000:1.0:1783138125.126561:0:24746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138125.130861:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138125.131136:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158012160 00000100:00100000:2.0:1783138125.131145:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158012160 00010000:00010000:2.0:1783138125.131195:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 9 pid: 24248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138125.131236:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1783138125.131245:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+9:2403:x1869755158012160:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783138125.131259:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783138125.131277:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 9 pid: 24248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.131291:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 9 pid: 24248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.131360:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000722c7da2/0x50a9699713c4d3be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a878 expref: 9 pid: 24248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.131378:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783138125.131382:0:22727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783138125.131387:0:22727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.131398:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.131431:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783138125.131488:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+8:2403:x1869755158012160:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 243us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138125.131503:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00010000:00010000:3.0:1783138125.131946:0:24746:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.131957:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.131979:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.132000:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.132007:0:24746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.132015:0:24746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9600 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138125.132019:0:24746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.132027:0:24746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.132049:0:24746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.132056:0:24746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009febb87b/0x50a9699713c4d3c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138125.132122:0:24746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:2402:x1869755158012032:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 14279us (23048us total) trans 0 rc 0/0 00000100:00100000:3.0:1783138125.132130:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:3.0:1783138125.144580:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1783138125.144962:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158012416 00000100:00100000:2.0:1783138125.144972:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158012416 00000100:00100000:2.0:1783138125.145030:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:2.0:1783138125.145050:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+16:18801:x1869755158012416:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783138125.145130:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.145149:0:22742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d316 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a839 expref: 16 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.145160:0:22742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.145196:0:22742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d316 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a839 expref: 16 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.145211:0:22742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d316 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a839 expref: 16 pid: 22743 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138125.145224:0:22742:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f3f48e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22742:1869755175950848:192.168.203.43@tcp:104: 00000100:00100000:2.0:1783138125.145303:0:22742:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f3e180f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783138125.149951:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138125.150054:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158012544 00000100:00100000:0.0:1783138125.150078:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158012544 00010000:00010000:0.0:1783138125.150118:0:22728:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d316 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a839 expref: 17 pid: 22743 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138125.150159:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:0.0:1783138125.150168:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+17:2403:x1869755158012544:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783138125.150181:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783138125.150188:0:22728:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d316 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a839 expref: 17 pid: 22743 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.150203:0:22728:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d316 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a839 expref: 17 pid: 22743 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.150225:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:0.0:1783138125.150231:0:22728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d332 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a847 expref: 17 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.150242:0:22728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.150250:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.150258:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.150276:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783138125.150369:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+17:2403:x1869755158012544:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 201us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138125.150387:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00010000:00010000:3.0:1783138125.150696:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d316 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a839 expref: 16 pid: 22743 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138125.150769:0:22742:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f3f48e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22742:1869755175950848:192.168.203.43@tcp:104: 00010000:00010000:3.0:1783138125.150789:0:22742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.150798:0:22742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.150805:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.150986:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.150997:0:22742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d39b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a863 expref: 16 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.151005:0:22742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.151031:0:22742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d39b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a863 expref: 16 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.151053:0:22742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d39b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a863 expref: 16 pid: 22744 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138125.151065:0:22742:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22742:1869755175950976:192.168.203.43@tcp:104: 00000100:00100000:3.0:1783138125.151130:0:22742:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f02bcd180 going to sleep for 11 seconds 00000100:00100000:2.0:1783138125.156227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138125.156356:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158012672 00000100:00100000:1.0:1783138125.156367:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158012672 00010000:00010000:1.0:1783138125.156406:0:22729:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d39b lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a863 expref: 17 pid: 22744 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783138125.156440:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1783138125.156461:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+17:2403:x1869755158012672:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783138125.156476:0:22729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783138125.156483:0:22729:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d39b lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a863 expref: 17 pid: 22744 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.156495:0:22729:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d39b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a863 expref: 17 pid: 22744 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.156518:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e03438300) 00010000:00010000:1.0:1783138125.156523:0:22729:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.156534:0:22729:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.156541:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783138125.156577:0:22729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783138125.156633:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10dbad77-f39f-415a-b3e7-d386fe5df21f+17:2403:x1869755158012672:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 173us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138125.156641:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00010000:00010000:3.0:1783138125.157167:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9a00/0x50a9699713c4d39b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x40dea3941757a863 expref: 16 pid: 22744 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138125.157186:0:22742:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22742:1869755175950976:192.168.203.43@tcp:104: 00010000:00010000:3.0:1783138125.157204:0:22742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.157213:0:22742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.157219:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783138125.157374:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1783138125.157645:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1783138125.157682:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1783138125.157758:0:22742:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f362d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22742:1869755175951104:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783138125.157811:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783138125.157886:0:22742:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2aecdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783138125.166091:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175951104 00000100:00100000:2.0:1783138125.166108:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175951104 00000100:00100000:2.0:1783138125.166180:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783138125.166208:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22742:x1869755175951104:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783138125.166382:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22742:x1869755175951104:12345-0@lo:1000:mdt00_000.0 Request processed in 176us (8569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138125.166390:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783138125.166707:0:22742:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f362d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22742:1869755175951104:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1783138125.166921:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1783138125.166998:0:22742:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0399dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22742:1869755175951232:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783138125.167049:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138125.167072:0:22742:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a951840 going to sleep for 11 seconds 00000100:00100000:1.0:1783138125.167281:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175951232 00000100:00100000:1.0:1783138125.167287:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175951232 00000100:00100000:1.0:1783138125.167365:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783138125.167373:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22742:x1869755175951232:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783138125.167517:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22742:x1869755175951232:12345-0@lo:1000:mdt00_000.0 Request processed in 145us (468us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1783138125.167525:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783138125.167780:0:22742:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0399dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22742:1869755175951232:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1783138125.167819:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167829:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167837:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167843:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8e00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:0.0:1783138125.167848:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167855:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167870:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e03438300) 00010000:00010000:0.0:1783138125.167873:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783138125.167877:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167883:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8e00/0x50a9699713c4d3d3 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167940:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167945:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167951:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167956:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e041f9400 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:0.0:1783138125.167959:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167965:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167973:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:0.0:1783138125.167975:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783138125.167983:0:22742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d332 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a847 expref: 19 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.167993:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d332 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a847 expref: 19 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.168003:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d332 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a847 expref: 19 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.168029:0:22742:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8200/0x50a9699713c4d332 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a847 expref: 19 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138125.168064:0:22742:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0399fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22742:1869755175951360:192.168.203.43@tcp:105: 00000100:00100000:0.0:1783138125.168123:0:22742:0:(client.c:2701:ptlrpc_set_wait()) set ffff9e3f2a951840 going to sleep for 11 seconds 00000100:00100000:2.0:1783138125.172086:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138125.172253:0:22742:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0399fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22742:1869755175951360:192.168.203.43@tcp:105: 00010000:00010000:0.0:1783138125.172280:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172292:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e041f9400/0x50a9699713c4d32b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172370:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4d3da lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172384:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4d3da lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172395:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4d3da lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172406:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4d3da lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172412:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4d3da lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172418:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4d3da lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138125.172424:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158012800 00010000:00010000:0.0:1783138125.172425:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028ff600 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:0.0:1783138125.172431:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4d3da lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138125.172434:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158012800 00000100:00100000:3.0:1783138125.172492:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1783138125.172501:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f360b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+20:18800:x1869755158012800:12345-192.168.203.43@tcp:49:dd.0 00010000:00010000:0.0:1783138125.172571:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4d3da lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172585:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:0.0:1783138125.172588:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783138125.172592:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4d3da lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172599:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ff600/0x50a9699713c4d3da lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172619:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138125.172624:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f360b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+20:18800:x1869755158012800:12345-192.168.203.43@tcp:49:dd.0 Request processed in 121us (549us total) trans 0 rc 0/0 00010000:00010000:0.0:1783138125.172628:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138125.172637:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00010000:00010000:0.0:1783138125.172638:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172645:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3f3098fc00 already unused, calling callback (ffffffffc1afd4f0) 00010000:00010000:0.0:1783138125.172648:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172654:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172663:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:0.0:1783138125.172666:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783138125.172669:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.172684:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3f3098fc00/0x50a9699713c4d3cc lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138125.172807:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f362d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+19:18801:x1869755158012416:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 27758us (28235us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1783138125.172815:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000020:00080000:0.0:1783138125.172819:0:22742:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783138125.172949:0:22776:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783138125.172954:0:22776:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783138125.172971:0:22776:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1783138125.172984:0:22776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1783138125.176142:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1783138125.176231:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138125.180082:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158013056 00000100:00100000:3.0:1783138125.180250:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158013056 00000100:00100000:0.0:1783138125.180306:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158013184 00000100:00100000:0.0:1783138125.180338:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158013184 00000100:00100000:3.0:1783138125.180364:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1783138125.180378:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+20:18801:x1869755158013056:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783138125.180396:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:0.0:1783138125.180408:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+20:18800:x1869755158013184:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:0.0:1783138125.180420:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783138125.180655:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d3e1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40dea3941757a87f expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783138125.180665:0:22746:0:(mdd_object.c:4010:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1783138125.180693:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d3e8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783138125.180699:0:22746:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1783138125.180709:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d3e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.180723:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d3e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22743 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.180727:0:22746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d3ef lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.180739:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d3ef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.180749:0:22746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d3ef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.180758:0:22746:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d3ef lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.180765:0:22746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d3ef lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.180771:0:22746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d3ef lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.180797:0:22746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783138125.180819:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028ffa00/0x50a9699713c4d3e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a87f expref: 24 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.180837:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028fe600/0x50a9699713c4d3e8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x40dea3941757a87f expref: 23 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.180854:0:22743:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e3e03438a00) 00010000:00010000:0.0:1783138125.180857:0:22743:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783138125.180861:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e3e028fe600, rc 0) 00010000:00010000:2.0:1783138125.180889:0:22730:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783138125.180897:0:22730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d3ef lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138125.180900:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+23:18801:x1869755158013056:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 524us (4764us total) trans 12884901918 rc 0/0 00010000:00010000:2.0:1783138125.180914:0:22730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b8400 already unused, calling callback (ffffffffc0ef3ce0) 00000100:00100000:3.0:1783138125.180917:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000020:00080000:3.0:1783138125.180923:0:22746:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783138125.180932:0:22730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d3ef lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.180942:0:22730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d3ef lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.180955:0:22730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e3e03438300) 00010000:00010000:2.0:1783138125.180958:0:22730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783138125.180962:0:22730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d3ef lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.180968:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e3e028b8400/0x50a9699713c4d3ef lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22746 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783138125.180983:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138125.180986:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783138125.180990:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138125.192027:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10dbad77-f39f-415a-b3e7-d386fe5df21f+22:18800:x1869755158013184:12345-192.168.203.43@tcp:101:dd.0 Request processed in 11610us (15783us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138125.192050:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:1.0:1783138125.242767:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1783138125.242913:0:24254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158013312 00000100:00100000:0.0:1783138125.242923:0:24254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158013312 00000100:00100000:0.0:1783138125.242987:0:24254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:0.0:1783138125.242996:0:24254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f2f871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:2403:x1869755158013312:12345-192.168.203.43@tcp:4:dd.0 00002000:00010000:0.0:1783138125.243049:0:24254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a48874c, atime: 0x6a48874b, ctime: 0x6a48874c, blocks: 0x0 00010000:00010000:0.0:1783138125.243058:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005251c9c/0x50a9699713c4d3f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.243075:0:24254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1783138125.243079:0:24254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783138125.243087:0:24254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005251c9c/0x50a9699713c4d3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.243100:0:24254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005251c9c/0x50a9699713c4d3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783138125.247779:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1783138125.247855:0:24256:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1783138125.247874:0:24256:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1783138125.248776:0:24256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755158013440 00000100:00100000:2.0:1783138125.248786:0:24256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755158013440 00000100:00100000:3.0:1783138125.249550:0:25787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:3.0:1783138125.249564:0:25787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3f3f48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+8:2402:x1869755158013440:12345-192.168.203.43@tcp:4:dd.0 00010000:00010000:3.0:1783138125.249598:0:25787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4d3fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.249617:0:25787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138125.249622:0:25787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783138125.249628:0:25787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4d3fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.249643:0:25787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4d3fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783138125.384525:0:24245:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:2.0:1783138125.384553:0:24245:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1783138125.385581:0:24254:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1783138125.385590:0:24254:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1783138124 -> 1783138125 00002000:00010000:0.0:1783138125.385592:0:24254:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1783138124 -> 1783138125 00002000:00010000:0.0:1783138125.385606:0:24254:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1783138125.385627:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005251c9c/0x50a9699713c4d3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.385640:0:24254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005251c9c/0x50a9699713c4d3f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.385650:0:24254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005251c9c/0x50a9699713c4d3f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.385657:0:24254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028ffa00 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:0.0:1783138125.385662:0:24254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005251c9c/0x50a9699713c4d3f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.385671:0:24254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005251c9c/0x50a9699713c4d3f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.385694:0:24254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005251c9c/0x50a9699713c4d3f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783138125.385702:0:24254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005251c9c/0x50a9699713c4d3f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783138125.385793:0:24254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f2f871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10dbad77-f39f-415a-b3e7-d386fe5df21f+7:2403:x1869755158013312:12345-192.168.203.43@tcp:4:dd.0 Request processed in 142793us (143033us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1783138125.385804:0:24254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000001:00080000:2.0:1783138125.408406:0:24245:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:3.0:1783138125.408621:0:25787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:3.0:1783138125.408626:0:25787:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:3.0:1783138125.408645:0:25787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4d3fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.408659:0:25787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4d3fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.408668:0:25787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4d3fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.408676:0:25787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e3e028b9200 already unused, calling callback (ffffffffc0ef3ce0) 00010000:00010000:3.0:1783138125.408681:0:25787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4d3fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.408702:0:25787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4d3fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.408721:0:25787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4d3fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783138125.408730:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdfdd112/0x50a9699713c4d3fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783138125.408843:0:25787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3f3f48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:10dbad77-f39f-415a-b3e7-d386fe5df21f+5:2402:x1869755158013440:12345-192.168.203.43@tcp:4:dd.0 Request processed in 159277us (161069us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1783138125.408855:0:25787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00010000:00010000:0.0:1783138125.629867:0:25131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783138126.650501:0:22731:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783138127.114340:0:25825:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1783138127.676398:0:25130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783138127.739508:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783138127.739558:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175951488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783138127.739646:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783138127.739799:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175951488 00000100:00100000:1.0:1783138127.739809:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175951488 00000100:00100000:1.0:1783138127.739882:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783138127.739895:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175951488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783138127.739931:0:24253:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1783138127.739998:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1869755175951488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783138127.740007:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783138127.740108:0:3660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1869755175951488:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783138127.740133:0:22738:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783138128.260556:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3f2f8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175951744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783138128.260646:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138128.260837:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783138128.260847:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e3e0399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175951616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783138128.260873:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783138128.260915:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175951744 00000100:00100000:0.0:1783138128.260923:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175951744 00000100:00100000:0.0:1783138128.260974:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755175951616 00000100:00100000:0.0:1783138128.260978:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755175951616 00000100:00100000:0.0:1783138128.260994:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783138128.261002:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175951744:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783138128.261768:0:23767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783138128.261783:0:23767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e3e0399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175951616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783138128.261809:0:23767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783138128.261870:0:23767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1869755175951616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1783138128.261877:0:23767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783138128.262029:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3e0399c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1869755175951616:0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783138128.262487:0:22748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1783138128.262539:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e3e0399d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1869755175951744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1535us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1783138128.262546:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783138128.263277:0:3659:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9e3f2f8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1869755175951744:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783138128.702140:0:22730:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14056 lines, 14056 kept, 0 dropped, 0 bad.