00010000:00010000:0.0F:1788448644.798047:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1788448645.822711:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788448645.823848:0:17125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788448645.823866:0:17125:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc0823aeb40 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1788448645.823871:0:17125:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc187705800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc0823ae180 00000020:00080000:1.0:1788448645.823875:0:17125:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc1a02e3b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc1b48ae000 00010000:00010000:0.0:1788448645.823985:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448645.823998:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448645.824007:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448645.824014:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448645.824021:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448645.824030:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448645.824051:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:0.0:1788448645.824054:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448645.824072:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448645.824078:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0F:1788448645.826479:0:17185:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1788448645.826959:0:17185:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788448645.991377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448645.991422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448645.991454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448645.991467:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801186176 00000100:00100000:0.0:1788448645.991480:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801186176 00000100:00100000:3.0:1788448645.991496:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448645.991552:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 169 00000100:00100000:0.0:1788448645.991568:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2400:x1875323801186176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0F:1788448645.991587:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801186432 00000100:00100000:2.0:1788448645.991606:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801186432 00000100:00100000:0.0:1788448645.991640:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2400:x1875323801186176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448645.991648:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801186304 00000100:00100000:2.0:1788448645.991652:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801186304 00000100:00100000:2.0:1788448645.991736:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:2.0:1788448645.991744:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801186432:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448645.991779:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801186432:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448645.991787:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:2.0:1788448645.991803:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:2.0:1788448645.991809:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+13:2400:x1875323801186304:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448645.991834:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+13:2400:x1875323801186304:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448645.991841:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00080000:3.0:1788448645.992819:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448645.992826:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448645.992834:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 169 00000100:00100000:0.0:1788448645.992996:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801186560 00000100:00100000:0.0:1788448645.993003:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801186560 00000100:00100000:0.0:1788448645.993062:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:0.0:1788448645.993072:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801186560:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:3.0:1788448645.993089:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448645.993125:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801186560:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 54us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448645.993132:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:1.0:1788448645.993539:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448645.993600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448645.993674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448645.994001:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801186688 00000100:00100000:0.0:1788448645.994007:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801186688 00000100:00100000:0.0:1788448645.994039:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801187072 00000100:00100000:0.0:1788448645.994042:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801187072 00000100:00100000:0.0:1788448645.994054:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801187200 00000100:00100000:0.0:1788448645.994057:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801187200 00000100:00100000:0.0:1788448645.994073:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:0.0:1788448645.994081:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2397:x1875323801186688:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:0.0:1788448645.994166:0:18651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804d35 00000100:00100000:3.0:1788448645.994176:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00080000:0.0:1788448645.994194:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba063000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788448645.994200:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2397:x1875323801187072:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788448645.994216:0:19177:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804d6d 00000100:00080000:3.0:1788448645.994228:0:19177:0:(import.c:65:import_set_state_nolock()) ffff9fc083f23800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788448645.994240:0:18651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000001:00000004:3.0:1788448645.994267:0:19177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788448645.994430:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+2:2397:x1875323801187072:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 233us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448645.994431:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+2:2397:x1875323801186688:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 347us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448645.994445:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:0.0:1788448645.994457:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:3.0:1788448645.994471:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:3.0:1788448645.994481:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2397:x1875323801187200:12345-192.168.206.21@tcp:9:kworker.0 00010000:00010000:0.0:1788448645.994488:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788448645.994495:0:19177:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804d74 00000100:00080000:3.0:1788448645.994504:0:19177:0:(import.c:65:import_set_state_nolock()) ffff9fc1872d6800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788448645.994989:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788448645.995004:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448645.995008:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1788448645.995057:0:19177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788448645.995131:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+2:2397:x1875323801187200:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 651us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448645.995138:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00010000:00010000:3.0:1788448645.995157:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448645.995658:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448645.995693:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448645.995749:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801186816 00000100:00100000:2.0:1788448645.995755:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801186816 00000100:00100000:2.0:1788448645.995934:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801186944 00000100:00100000:2.0:1788448645.995939:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801186944 00000100:00100000:3.0:1788448645.995965:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:2.0:1788448645.995974:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:3.0:1788448645.995980:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2400:x1875323801186816:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448645.995988:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2400:x1875323801186944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448645.996042:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2400:x1875323801186816:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448645.996052:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00080000:0.0:1788448645.996179:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448645.996197:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448645.996348:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2400:x1875323801186944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 364us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448645.996355:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:3.0:1788448646.336234:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448646.336254:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bfed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826432512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448646.336316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448646.336360:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826432512 00000100:00100000:3.0:1788448646.336366:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826432512 00000100:00100000:3.0:1788448646.336408:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788448646.336416:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826432512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448646.336449:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788448646.336488:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826432512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448646.336494:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788448646.336534:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bfed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826432512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448646.336680:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448646.336690:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826432640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448646.336723:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448646.336830:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826432640 00000100:00100000:1.0:1788448646.336835:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826432640 00000100:00100000:1.0:1788448646.336864:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788448646.336870:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826432640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448646.336908:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788448646.336948:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826432640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448646.336954:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788448646.337012:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826432640:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788448646.846224:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448646.846510:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bfed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826432768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448646.846597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448646.846791:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bfed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826432896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448646.846821:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448646.846859:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826432768 00000100:00100000:3.0:1788448646.846866:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826432768 00000100:00100000:3.0:1788448646.846952:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826432896 00000100:00100000:3.0:1788448646.846956:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826432896 00000100:00100000:0.0:1788448646.846968:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788448646.846982:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826432768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448646.847308:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788448646.847430:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826432768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 451us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448646.850472:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448646.850497:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826432896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448646.850524:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788448646.850669:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826432896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 184us (3847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448646.850690:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788448646.850719:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448646.850758:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bfed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826432896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448646.850802:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448646.852464:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bfed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826432768:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788448647.616610:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788448647.616618:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448647.616637:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788448647.616644:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788448647.657723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448647.657806:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801187328 00000100:00100000:2.0:1788448647.657817:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801187328 00000100:00100000:2.0:1788448647.658030:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:2.0:1788448647.658042:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+13:15584:x1875323801187328:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788448647.658144:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+13:15584:x1875323801187328:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 Request processed in 104us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448647.658152:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00080000:3.0:1788448647.658550:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448647.670284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448647.670386:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801187456 00000100:00100000:3.0:1788448647.670396:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801187456 00000100:00100000:3.0:1788448647.670468:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:3.0:1788448647.670480:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:15584:x1875323801187456:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788448647.670577:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:15584:x1875323801187456:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 Request processed in 99us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448647.670584:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00080000:2.0:1788448647.670784:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448647.673918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448647.674367:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801187712 00000100:00100000:2.0:1788448647.674378:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801187712 00000100:00100000:2.0:1788448647.674439:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:2.0:1788448647.674450:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+13:15584:x1875323801187712:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788448647.674674:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+14:15584:x1875323801187712:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 225us (765us total) trans 8589934624 rc 0/0 00000100:00100000:2.0:1788448647.674681:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00010000:00010000:2.0:1788448647.870226:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448648.382424:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826433408:0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.382502:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826433280:0@lo:400:kworker.0 00000100:00100000:2.0:1788448648.382509:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448648.382588:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826433920:0@lo:400:kworker.0 00000100:00100000:2.0:1788448648.382615:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448648.382635:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826434432:0@lo:400:kworker.0 00000100:00100000:3.0:1788448648.382641:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826433024:0@lo:400:kworker.0 00000100:00100000:2.0:1788448648.382662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448648.382782:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826433408 00000100:00100000:0.0:1788448648.382789:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826433408 00000100:00100000:0.0:1788448648.382839:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826433920 00000100:00100000:0.0:1788448648.382842:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826433920 00000100:00100000:0.0:1788448648.382863:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788448648.382872:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826433408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448648.382950:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826434432 00000100:00100000:2.0:1788448648.382955:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826434432 00000100:00100000:1.0:1788448648.382978:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448648.383002:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826433792:0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.383022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448648.383032:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826434304:0@lo:400:kworker.0 00000100:00100000:2.0:1788448648.383066:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788448648.383072:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448648.383079:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826434432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.383097:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788448648.383107:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826433152:0@lo:400:kworker.0 00000100:00100000:2.0:1788448648.383133:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826434432:12345-0@lo:400:kworker.0 Request processed in 58us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448648.383143:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788448648.383150:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448648.383160:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826434304 00000100:00100000:2.0:1788448648.383165:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826434304 00000100:00100000:1.0:1788448648.383192:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826433664:0@lo:400:kworker.0 00000100:00100000:2.0:1788448648.383210:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788448648.383290:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826434304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.383343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448648.383369:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826434176:0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.383392:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448648.383408:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826434688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448648.383430:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788448648.383460:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341f480 x1875323826434304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448648.383473:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826434304:0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.383501:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826434176 00000100:00100000:1.0:1788448648.383504:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826434176 00000100:00100000:1.0:1788448648.383540:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788448648.383547:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826434176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.383582:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826434176:12345-0@lo:400:kworker.0 Request processed in 35us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448648.383589:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788448648.383609:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826433152 00000100:00100000:1.0:1788448648.383613:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826433152 00000100:00100000:1.0:1788448648.383628:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826433664 00000100:00100000:1.0:1788448648.383630:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826433664 00000100:00100000:1.0:1788448648.383645:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788448648.383651:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826433152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.383682:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826433152:12345-0@lo:400:kworker.0 Request processed in 31us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448648.383687:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788448648.383708:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788448648.383714:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826433664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.383744:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826433664:12345-0@lo:400:kworker.0 Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448648.383750:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788448648.383780:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826433152:0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.383789:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826433664:0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.383797:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826434176:0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.383937:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826433280 00000100:00100000:1.0:1788448648.383942:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826433280 00000100:00100000:1.0:1788448648.383961:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826433792 00000100:00100000:1.0:1788448648.383963:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826433792 00000100:00100000:1.0:1788448648.383974:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788448648.383981:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826433920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.384014:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826433920:12345-0@lo:400:kworker.0 Request processed in 34us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448648.384020:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788448648.384032:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788448648.384038:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826433280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.384067:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826433280:12345-0@lo:400:kworker.0 Request processed in 29us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448648.384073:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788448648.384083:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788448648.384089:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826433792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.384113:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826433792:12345-0@lo:400:kworker.0 Request processed in 24us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448648.384126:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788448648.384152:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826433280:0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.384163:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826433792:0@lo:400:kworker.0 00000100:00080000:1.0:1788448648.384223:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448648.384228:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448648.384231:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448648.384233:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448648.384249:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826433920:0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.384260:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826434432:0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.384313:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448648.384323:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826434816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448648.384352:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448648.384391:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826434688 00000100:00100000:1.0:1788448648.384395:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826434688 00000100:00100000:1.0:1788448648.384417:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826434816 00000100:00100000:1.0:1788448648.384420:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826434816 00000100:00100000:1.0:1788448648.384431:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788448648.384437:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875323826434688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448648.384459:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788448648.384493:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875323826434688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448648.384499:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788448648.384511:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788448648.384517:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826434816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788448648.384540:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788448648.384576:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826434816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448648.384582:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788448648.384612:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826434816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448648.384638:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826434688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448648.387986:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826433408:12345-0@lo:400:kworker.0 Request processed in 5103us (5468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448648.388003:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788448648.388163:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448648.388237:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826433536:0@lo:400:kworker.0 00000100:00100000:3.0:1788448648.388281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448648.388389:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826433024 00000100:00100000:0.0:1788448648.388399:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826433024 00000100:00100000:0.0:1788448648.388624:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788448648.388674:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826434304:12345-0@lo:400:kworker.0 Request processed in 108us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448648.388685:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788448648.388854:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826434048:0@lo:400:kworker.0 00000100:00100000:0.0:1788448648.388967:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3648:x1875323826433024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448648.389023:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3648:x1875323826433024:12345-0@lo:400:kworker.0 Request processed in 390us (5750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448648.389030:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788448648.389121:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448648.389366:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826433408:0@lo:400:kworker.0 00000100:00100000:2.0:1788448648.389373:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826433536 00000100:00100000:2.0:1788448648.389380:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826433536 00000100:00100000:2.0:1788448648.389414:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788448648.389422:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826433536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448648.389473:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826433536:12345-0@lo:400:kworker.0 Request processed in 52us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448648.389479:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788448648.389556:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826434560:0@lo:400:kworker.0 00000100:00100000:3.0:1788448648.389583:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448648.390736:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826434048 00000100:00100000:1.0:1788448648.390747:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826434048 00000100:00100000:1.0:1788448648.390807:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788448648.390816:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826434048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.390896:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826434048:12345-0@lo:400:kworker.0 Request processed in 66us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448648.390903:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788448648.398181:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826434560 00000100:00100000:3.0:1788448648.400944:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826433024:0@lo:400:kworker.0 00000100:00100000:3.0:1788448648.400972:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826433536:0@lo:400:kworker.0 00000100:00100000:3.0:1788448648.400984:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826434048:0@lo:400:kworker.0 00000100:00100000:1.0:1788448648.401454:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826434560 00000100:00100000:1.0:1788448648.401545:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788448648.401555:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826434560:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788448648.401594:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448648.402232:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826434560:12345-0@lo:400:kworker.0 Request processed in 675us (12643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448648.402243:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1788448648.402272:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083e4e300 x1875323826434560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448648.402300:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826434560:0@lo:400:kworker.0 00010000:00010000:3.0:1788448648.894191:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448649.921569:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448650.942330:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448651.115992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448651.116086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448651.116121:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448651.116182:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801188224 00000100:00100000:0.0:1788448651.116193:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801188224 00000100:00100000:0.0:1788448651.116277:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:0.0:1788448651.116289:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801188224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448651.116386:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801188224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 99us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448651.116394:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00080000:2.0:1788448651.120263:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448651.123650:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801187968 00000100:00100000:1.0:1788448651.123669:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801187968 00000100:00100000:3.0:1788448651.123716:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448651.123745:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801187840 00000100:00100000:3.0:1788448651.123750:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801187840 00000100:00100000:3.0:1788448651.123786:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 171 00000100:00100000:3.0:1788448651.123797:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2401:x1875323801187840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448651.123862:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2401:x1875323801187840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448651.123871:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 171 00000100:00100000:3.0:1788448651.123957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:2.0:1788448651.124549:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448651.133629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448651.133690:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801188480 00000100:00100000:3.0:1788448651.133699:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801188480 00000100:00100000:3.0:1788448651.133748:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801188096 00000100:00100000:3.0:1788448651.133751:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801188096 00000100:00100000:3.0:1788448651.133762:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801188352 00000100:00100000:3.0:1788448651.133764:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801188352 00000100:00100000:3.0:1788448651.133781:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 83 00000100:00100000:3.0:1788448651.133790:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+14:2401:x1875323801187968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448651.133868:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+14:2401:x1875323801187968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 78us (17886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448651.133876:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 83 00000100:00100000:3.0:1788448651.133914:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:3.0:1788448651.133922:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801188480:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448651.133960:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801188480:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (17838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448651.133967:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:3.0:1788448651.133979:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:3.0:1788448651.133985:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801188096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448651.134008:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801188096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (10052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448651.134014:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:3.0:1788448651.134025:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:3.0:1788448651.134031:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2401:x1875323801188352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448651.134051:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2401:x1875323801188352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 20us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448651.134057:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00080000:2.0:1788448651.135685:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448651.135696:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1788448651.454566:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788448651.456293:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826434944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448651.456389:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448651.456864:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826435072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448651.456932:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448651.457109:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826434944 00000100:00100000:1.0:1788448651.457129:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826434944 00000100:00100000:1.0:1788448651.457215:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826435072 00000100:00100000:1.0:1788448651.457218:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826435072 00000100:00100000:1.0:1788448651.457239:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448651.457249:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826434944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448651.457293:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000001:00100000:0.0:1788448651.462982:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000020:00000080:0.0:1788448651.462999:0:19465:0:(genops.c:885:class_export_put()) final put ffff9fc1872d4000/ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000001:00100000:0.0:1788448651.463022:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03254173-b90a-4634-8f44-6b5b52d8ff13 00000020:00000080:0.0:1788448651.463025:0:19465:0:(genops.c:885:class_export_put()) final put ffff9fc1ba060000/03254173-b90a-4634-8f44-6b5b52d8ff13 00000100:00100000:1.0:1788448651.464128:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826434944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6868us (7727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448651.464145:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448651.464203:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788448651.464219:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826435072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448651.464290:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000020:00000080:3.0:1788448651.464376:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1872d4000/ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 for lustre-OST0001 00000100:00100000:1.0:1788448651.464385:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826435072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 174us (7452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448651.464391:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000020:00000080:3.0:1788448651.464433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba060000/03254173-b90a-4634-8f44-6b5b52d8ff13 for lustre-OST0001 00000020:00000080:3.0:1788448651.464458:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1872d6800 for lustre-OST0001 00000020:00000080:3.0:1788448651.464463:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1ba063000 for lustre-OST0001 00000100:00100000:1.0:1788448651.464657:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826435072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448651.464714:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826434944:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1788448651.465536:0:17125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934624 is committed 00000020:00080000:1.0:1788448651.465552:0:17125:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000001:00100000:1.0:1788448651.465963:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000020:00000080:1.0:1788448651.465970:0:18646:0:(genops.c:885:class_export_put()) final put ffff9fc083f22800/ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000020:00080000:3.0:1788448651.465972:0:17185:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1788448651.465993:0:17185:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00000080:0.0:1788448651.466047:0:16256:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083f22800/ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 for lustre-OST0000 00000020:00000080:0.0:1788448651.468097:0:16256:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc083f23800 for lustre-OST0000 00000100:00100000:2.0:1788448651.970819:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826435200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448651.970938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448651.970993:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448651.971000:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826435328:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788448651.971007:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448651.971029:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448651.971086:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826435200 00000100:00100000:2.0:1788448651.971096:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826435200 00000100:00080000:1.0:1788448651.971159:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448651.971180:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826435328 00000100:00100000:2.0:1788448651.971184:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826435328 00000100:00100000:2.0:1788448651.971215:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788448651.971222:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448651.971228:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826435200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448651.971269:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788448651.971338:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826435200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448651.971346:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448651.971381:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448651.971388:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826435328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448651.971398:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788448651.971424:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826435328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448651.971431:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788448651.972200:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826435328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448651.972222:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826435200:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788448652.365783:0:20525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 11:17:30 (1788448650) 00010000:00010000:3.0:1788448652.991429:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448653.504396:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826435584:0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.504606:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448653.504623:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826435456:0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.504670:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826436096:0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.504671:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448653.504701:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448653.504711:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826435968:0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.504725:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826436608:0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.504755:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448653.504761:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826435712:0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.504785:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826436480:0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.504792:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448653.504816:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826436224:0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.504821:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448653.504851:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826436992:0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.504857:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448653.504901:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448653.504928:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448653.504934:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826437120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448653.504960:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448653.505000:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826435840:0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.505024:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448653.505039:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826436352:0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.505060:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448653.505080:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826436864:0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.505103:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448653.505150:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826435456 00000100:00100000:2.0:1788448653.505166:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826435456 00000100:00100000:3.0:1788448653.505172:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826436736:0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.505204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448653.505224:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788448653.505228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826437248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448653.505238:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3647:x1875323826435456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.505252:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448653.505286:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826435584 00000100:00100000:3.0:1788448653.505291:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826435584 00000100:00100000:2.0:1788448653.505307:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3647:x1875323826435456:12345-0@lo:400:kworker.0 Request processed in 72us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448653.505312:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826436096 00000100:00100000:3.0:1788448653.505316:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826436096 00000100:00100000:2.0:1788448653.505318:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788448653.505335:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788448653.505343:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826435584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.505362:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826435968 00000100:00100000:2.0:1788448653.505368:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826435968 00000100:00100000:3.0:1788448653.505384:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826435584:12345-0@lo:400:kworker.0 Request processed in 41us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448653.505391:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788448653.505393:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826436480 00000100:00100000:2.0:1788448653.505397:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826436480 00000100:00100000:3.0:1788448653.505409:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788448653.505415:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826436992 00000100:00100000:3.0:1788448653.505419:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826436096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.505421:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826436992 00000100:00100000:2.0:1788448653.505454:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826436864 00000100:00100000:3.0:1788448653.505455:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826436096:12345-0@lo:400:kworker.0 Request processed in 38us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448653.505463:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788448653.505469:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826436864 00000100:00100000:3.0:1788448653.505491:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826435712 00000100:00100000:2.0:1788448653.505492:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826436736 00000100:00100000:3.0:1788448653.505496:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826435712 00000100:00100000:2.0:1788448653.505498:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826436736 00000100:00100000:2.0:1788448653.505527:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788448653.505534:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826435968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.505566:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826435968:12345-0@lo:400:kworker.0 Request processed in 32us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448653.505572:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788448653.505585:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788448653.505591:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826436480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.505616:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826436480:12345-0@lo:400:kworker.0 Request processed in 26us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448653.505618:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826436224 00000100:00100000:3.0:1788448653.505623:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826436224 00000100:00100000:2.0:1788448653.505628:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788448653.505645:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788448653.505647:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826435840 00000100:00100000:3.0:1788448653.505651:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826435840 00000100:00100000:2.0:1788448653.505655:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826436992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.505666:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826436352 00000100:00100000:3.0:1788448653.505670:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826436352 00000100:00100000:3.0:1788448653.505688:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788448653.505697:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826435712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.505705:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826436992:12345-0@lo:400:kworker.0 Request processed in 52us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448653.505713:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788448653.505729:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788448653.505736:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826436864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.505742:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826435712:12345-0@lo:400:kworker.0 Request processed in 45us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448653.505750:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788448653.505766:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788448653.505775:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826436224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.505780:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826436864:12345-0@lo:400:kworker.0 Request processed in 43us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448653.505788:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788448653.505806:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788448653.505810:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826436224:12345-0@lo:400:kworker.0 Request processed in 37us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448653.505817:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826436736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.505822:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788448653.505839:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788448653.505847:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826435840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.505859:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826436736:12345-0@lo:400:kworker.0 Request processed in 45us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448653.505866:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788448653.505915:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826437120 00000100:00100000:2.0:1788448653.505919:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826437120 00000100:00100000:2.0:1788448653.505947:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826437248 00000100:00100000:2.0:1788448653.505950:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826437248 00000100:00100000:2.0:1788448653.505962:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448653.505969:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875323826437120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448653.505991:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788448653.506032:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875323826435840:12345-0@lo:400:kworker.0 Request processed in 185us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448653.506040:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788448653.506056:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788448653.506063:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1875323826436352:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788448653.507702:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448653.507710:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448653.507714:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448653.507717:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448653.507752:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788448653.507767:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875323826437248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448653.507789:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788448653.509037:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826437120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3061us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448653.509051:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448653.509120:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826435840:0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.509135:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826436864:0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.511104:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1875323826436352:12345-0@lo:400:kworker.0 Request processed in 5033us (6034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448653.511127:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788448653.511231:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826435712:0@lo:400:kworker.0 00000100:00100000:3.0:1788448653.511244:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826436224:0@lo:400:kworker.0 00010000:00080000:3.0:1788448653.511258:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba34f480 x1875323826436736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448653.511269:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826436736:0@lo:400:kworker.0 00000100:00100000:1.0:1788448653.511721:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826437120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448653.511742:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826435456:0@lo:400:kworker.0 00000100:00100000:1.0:1788448653.511754:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826435968:0@lo:400:kworker.0 00000100:00100000:1.0:1788448653.511766:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826436480:0@lo:400:kworker.0 00010000:00080000:1.0:1788448653.511777:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba34e680 x1875323826436992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448653.511785:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826436992:0@lo:400:kworker.0 00000100:00100000:1.0:1788448653.511833:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448653.511870:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826435584:0@lo:400:kworker.0 00000100:00100000:1.0:1788448653.512137:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826436096:0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.512445:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826436352:0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.512478:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826436608 00000100:00100000:2.0:1788448653.512484:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826436608 00000100:00100000:2.0:1788448653.512547:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788448653.512555:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826436608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448653.512612:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826436608:12345-0@lo:400:kworker.0 Request processed in 58us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448653.512618:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788448653.512645:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826436608:0@lo:400:kworker.0 00000100:00080000:1.0:1788448653.512699:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448653.525922:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826437248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 18148us (20657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448653.525940:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788448653.526100:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826437248:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788448654.014285:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448655.040539:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448656.066640:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448656.231541:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448656.231582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448656.231621:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448656.231718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448656.231772:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801188608 00000100:00100000:3.0:1788448656.231782:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801188608 00000100:00100000:3.0:1788448656.231852:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 173 00000100:00100000:3.0:1788448656.231862:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2400:x1875323801188608:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448656.231958:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2400:x1875323801188608:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 98us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448656.231966:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 173 00000100:00100000:2.0:1788448656.238925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448656.238962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448656.242138:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801188864 00000100:00100000:1.0:1788448656.242155:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801188864 00000100:00100000:1.0:1788448656.242246:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801189120 00000100:00100000:1.0:1788448656.242250:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801189120 00000100:00100000:1.0:1788448656.242270:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801188736 00000100:00100000:1.0:1788448656.242273:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801188736 00000100:00100000:1.0:1788448656.242434:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 93 00000100:00100000:1.0:1788448656.242444:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801188864:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448656.242548:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801188864:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 105us (10965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448656.242572:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 93 00000100:00100000:1.0:1788448656.242590:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 94 00000100:00100000:1.0:1788448656.242596:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2400:x1875323801189120:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448656.242622:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2400:x1875323801189120:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (11002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448656.242627:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 94 00000100:00100000:1.0:1788448656.242637:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00100000:1.0:1788448656.242642:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+13:2400:x1875323801188736:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448656.242663:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+13:2400:x1875323801188736:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 21us (10947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448656.242668:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00080000:1.0:1788448656.242688:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448656.242691:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448656.242728:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801188992 00000100:00100000:1.0:1788448656.242733:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801188992 00000100:00100000:1.0:1788448656.242769:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:1.0:1788448656.242776:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801188992:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448656.242811:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801188992:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (3898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448656.242817:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00080000:1.0:1788448656.243154:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448656.244546:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801189248 00000100:00100000:1.0:1788448656.244557:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801189248 00000100:00100000:1.0:1788448656.244631:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:1.0:1788448656.244642:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2400:x1875323801189248:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448656.244717:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2400:x1875323801189248:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (5754us total) trans 0 rc 0/0 00000100:00080000:2.0:1788448656.245104:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448656.245472:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:1.0:1788448656.479275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448656.479449:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801189504 00000100:00100000:3.0:1788448656.479460:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801189504 00000100:00100000:3.0:1788448656.479521:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:3.0:1788448656.479529:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+13:16346:x1875323801189504:12345-192.168.206.21@tcp:35:umount.0 00000001:00080000:3.0:1788448656.479747:0:17148:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1788448656.479842:0:17148:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1788448656.480146:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+16:16346:x1875323801189504:12345-192.168.206.21@tcp:35:umount.0 Request processed in 615us (877us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1788448656.480163:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000020:00080000:3.0:1788448656.480167:0:17148:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788448656.487074:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448656.487113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448656.487158:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448656.487204:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448656.487391:0:20175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801189760 00000100:00100000:1.0:1788448656.487402:0:20175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801189760 00000100:00100000:1.0:1788448656.487465:0:20175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801190016 00000100:00100000:1.0:1788448656.487468:0:20175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801190016 00000100:00100000:1.0:1788448656.487484:0:20175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801189888 00000100:00100000:1.0:1788448656.487486:0:20175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801189888 00000100:00100000:1.0:1788448656.487508:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:1.0:1788448656.487518:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+15:2400:x1875323801189760:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448656.487533:0:20175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448656.487554:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204ba00/0xf45a9e4e6b804d0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0996 expref: 15 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448656.487572:0:20175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448656.487618:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+14:2400:x1875323801189760:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 102us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448656.487626:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:1.0:1788448656.487642:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:1.0:1788448656.487648:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0837bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2400:x1875323801190016:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448656.487654:0:20175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448656.487662:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804d97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a7d expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448656.487671:0:20175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448656.487694:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0837bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:2400:x1875323801190016:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 47us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448656.487700:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:1.0:1788448656.487738:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:1.0:1788448656.487745:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:2400:x1875323801189888:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448656.487753:0:20175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448656.487761:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204aa00/0xf45a9e4e6b804d12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09c7 expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448656.487770:0:20175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448656.487785:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:2400:x1875323801189888:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 41us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448656.487792:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:3.0:1788448656.489518:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801189632 00000100:00100000:3.0:1788448656.489533:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801189632 00000100:00100000:3.0:1788448656.489599:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:3.0:1788448656.489609:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2397:x1875323801189632:12345-192.168.206.21@tcp:9:umount.0 00000020:00000080:3.0:1788448656.489646:0:18652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804d2e 00000100:00080000:3.0:1788448656.489658:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb1e3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788448656.489716:0:18652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788448656.489910:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+2:2397:x1875323801189632:12345-192.168.206.21@tcp:9:umount.0 Request processed in 271us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448656.489918:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00010000:00010000:2.0:1788448656.493211:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448656.500928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448656.501045:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801190912 00000100:00100000:1.0:1788448656.501055:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801190912 00000100:00100000:1.0:1788448656.501105:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:1.0:1788448656.501115:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+16:2397:x1875323801190912:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:1.0:1788448656.501157:0:17145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804d20 00000020:00010000:1.0:1788448656.501173:0:17145:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc0831ce000: total 0 00000100:00080000:1.0:1788448656.501177:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9fc187515800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788448656.501208:0:17145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:1.0:1788448656.501382:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+15:2397:x1875323801190912:12345-192.168.206.21@tcp:39:umount.0 Request processed in 268us (464us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788448656.501390:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 67 00000020:00010000:3.0:1788448656.501476:0:17134:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc0831ce000: total 0 00010000:00010000:3.0:1788448656.501543:0:17134:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc0831ce000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788448656.501586:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:3.0:1788448656.501590:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788448656.501598:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aed expref: 14 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.501617:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:3.0:1788448656.501619:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788448656.501623:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5400/0xf45a9e4e6b805030 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b3a expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.501637:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc08319b700) 00010000:00010000:3.0:1788448656.501640:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448656.501657:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804e07 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a8b expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.501676:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08319bf00) 00010000:00010000:3.0:1788448656.501679:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448656.501683:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a99 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.501694:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:3.0:1788448656.501696:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788448656.501700:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804fd5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b17 expref: 10 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.501715:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc1bb7b4500) 00010000:00010000:3.0:1788448656.501717:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448656.501720:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4e00/0xf45a9e4e6b804deb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a84 expref: 9 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.501735:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:3.0:1788448656.501737:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788448656.501740:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b804ecb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ac3 expref: 8 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.501751:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:3.0:1788448656.501753:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448656.501756:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804f7a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b02 expref: 7 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.501768:0:17134:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc0831ce000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1788448656.501788:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448656.501790:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448656.501792:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448656.512342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448656.512434:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801191040 00000100:00100000:1.0:1788448656.512447:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801191040 00000100:00100000:1.0:1788448656.512516:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:1.0:1788448656.512544:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2397:x1875323801191040:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:1.0:1788448656.512576:0:19479:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804d27 00000100:00080000:1.0:1788448656.512592:0:19479:0:(import.c:65:import_set_state_nolock()) ffff9fc1872d7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788448656.512623:0:19479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788448656.512863:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+3:2397:x1875323801191040:12345-192.168.206.21@tcp:39:umount.0 Request processed in 321us (530us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788448656.512871:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 68 00010000:00010000:3.0:1788448656.513118:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448656.574234:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448656.574256:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826437376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448656.574323:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448656.574375:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826437376 00000100:00100000:3.0:1788448656.574382:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826437376 00000100:00100000:3.0:1788448656.574429:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788448656.574440:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826437376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448656.574474:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788448656.574532:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826437376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448656.574540:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788448656.574586:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826437376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448656.578013:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826437504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448656.578091:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448656.578245:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826437504 00000100:00100000:1.0:1788448656.578253:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826437504 00000100:00100000:1.0:1788448656.578305:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788448656.578314:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826437504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448656.578346:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788448656.578386:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826437504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448656.578393:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788448656.578849:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826437504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448657.088785:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826437632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448657.088869:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448657.089073:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448657.089082:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448657.089091:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826437760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448657.089137:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448657.089170:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826437632 00000100:00100000:2.0:1788448657.089177:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826437632 00000100:00100000:2.0:1788448657.089222:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826437760 00000100:00100000:2.0:1788448657.089225:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826437760 00000100:00100000:2.0:1788448657.089240:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448657.089249:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826437632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448657.089281:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788448657.089318:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826437632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448657.089324:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448657.089338:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788448657.089344:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826437760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448657.089351:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788448657.089371:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826437760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 28us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448657.089376:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788448657.089388:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448657.089416:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826437760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448657.089495:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826437632:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788448657.854155:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788448657.854168:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448657.854188:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788448657.854198:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788448658.111409:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448658.622252:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826438016:0@lo:400:kworker.0 00000100:00100000:0.0:1788448658.622327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448658.622401:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826438016 00000100:00100000:0.0:1788448658.622408:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826438016 00000100:00100000:0.0:1788448658.622475:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788448658.622483:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826438016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448658.622534:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826438016:12345-0@lo:400:kworker.0 Request processed in 51us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448658.622541:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788448658.622577:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826438016:0@lo:400:kworker.0 00000100:00100000:0.0:1788448658.622611:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826438144:0@lo:400:kworker.0 00000100:00100000:0.0:1788448658.622635:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448658.622686:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826438528:0@lo:400:kworker.0 00000100:00100000:0.0:1788448658.622707:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448658.622731:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826438528 00000100:00100000:0.0:1788448658.622735:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826438528 00000100:00100000:0.0:1788448658.622752:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788448658.622758:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826438528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448658.622789:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826438528:12345-0@lo:400:kworker.0 Request processed in 31us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448658.622795:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788448658.623030:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826438528:0@lo:400:kworker.0 00000100:00100000:0.0:1788448658.623065:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826438656:0@lo:400:kworker.0 00000100:00100000:0.0:1788448658.623088:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448658.623150:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826439040:0@lo:400:kworker.0 00000100:00100000:0.0:1788448658.623179:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448658.623236:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826439168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448658.623271:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448658.623301:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826439168 00000100:00100000:2.0:1788448658.623305:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826439168 00000100:00080000:0.0:1788448658.623332:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448658.623336:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448658.623342:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826439552:0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.623343:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826439168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448658.623364:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788448658.623373:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448658.623392:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826439168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448658.623399:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788448658.623428:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826439168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448658.624489:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826437888:0@lo:400:kworker.0 00000100:00100000:3.0:1788448658.624558:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448658.624611:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826438400:0@lo:400:kworker.0 00000100:00100000:3.0:1788448658.624634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448658.624662:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826438912:0@lo:400:kworker.0 00000100:00100000:3.0:1788448658.624680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448658.624698:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826439424:0@lo:400:kworker.0 00000100:00100000:3.0:1788448658.624713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448658.624733:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788448658.624749:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826438272:0@lo:400:kworker.0 00000100:00100000:3.0:1788448658.624773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448658.624788:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826438784:0@lo:400:kworker.0 00000100:00100000:3.0:1788448658.624803:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448658.624819:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826439296:0@lo:400:kworker.0 00000100:00100000:3.0:1788448658.624838:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448658.624863:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826438144 00000100:00100000:3.0:1788448658.624869:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826438144 00000100:00100000:3.0:1788448658.624932:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826438656 00000100:00100000:3.0:1788448658.624936:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826438656 00000100:00100000:3.0:1788448658.624947:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826438272 00000100:00100000:3.0:1788448658.624950:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826438272 00000100:00100000:3.0:1788448658.624970:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826438784 00000100:00100000:3.0:1788448658.624972:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826438784 00000100:00100000:3.0:1788448658.624984:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788448658.625008:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826438144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448658.625057:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826438144:12345-0@lo:400:kworker.0 Request processed in 66us (2421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448658.625064:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788448658.625081:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788448658.625086:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826438656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448658.625126:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826438656:12345-0@lo:400:kworker.0 Request processed in 27us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448658.625132:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788448658.625143:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788448658.625149:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826438272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448658.625308:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826437888 00000100:00100000:0.0:1788448658.625313:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826437888 00000100:00100000:0.0:1788448658.625342:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788448658.625348:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3646:x1875323826437888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448658.625431:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788448658.625441:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826438784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.630697:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826438656:0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.630720:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826438144:0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.630774:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826439040 00000100:00100000:2.0:1788448658.630781:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826439040 00000100:00100000:2.0:1788448658.630827:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826439552 00000100:00100000:2.0:1788448658.630830:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826439552 00000100:00100000:2.0:1788448658.630844:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826438400 00000100:00100000:2.0:1788448658.630848:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826438400 00000100:00100000:2.0:1788448658.630859:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826438912 00000100:00100000:2.0:1788448658.630861:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826438912 00000100:00100000:2.0:1788448658.631437:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826439424 00000100:00100000:2.0:1788448658.631444:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826439424 00000100:00100000:2.0:1788448658.631478:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826439296 00000100:00100000:2.0:1788448658.631481:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826439296 00000100:00100000:2.0:1788448658.631504:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788448658.631513:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826439040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.631622:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826439040:12345-0@lo:400:kworker.0 Request processed in 110us (8441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448658.631642:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788448658.631682:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826439040:0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.631705:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788448658.631712:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826439552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.631750:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826439552:12345-0@lo:400:kworker.0 Request processed in 38us (8375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448658.631756:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1788448658.631782:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bff09c00 x1875323826439552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448658.631794:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826439552:0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.631810:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788448658.631816:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826438400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.631842:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826438400:12345-0@lo:400:kworker.0 Request processed in 27us (7207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448658.631848:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788448658.631858:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788448658.631864:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826438912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.631927:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826438912:12345-0@lo:400:kworker.0 Request processed in 63us (7245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448658.631933:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788448658.631944:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788448658.631950:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826439424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.631977:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826439424:12345-0@lo:400:kworker.0 Request processed in 27us (7262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448658.631990:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788448658.632002:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788448658.632009:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826439296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.632036:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826439296:12345-0@lo:400:kworker.0 Request processed in 29us (7197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448658.632042:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788448658.632129:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448658.632134:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448658.632137:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448658.632180:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3646:x1875323826437888:12345-0@lo:400:kworker.0 Request processed in 6829us (7619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448658.632189:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788448658.632338:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448658.632350:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826439680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448658.632388:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448658.633685:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826439680 00000100:00100000:0.0:1788448658.633693:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826439680 00000100:00100000:0.0:1788448658.633747:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448658.633757:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875323826439680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448658.633777:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788448658.633845:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875323826439680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448658.633851:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448658.633912:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826439680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448658.635186:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826438784:12345-0@lo:400:kworker.0 Request processed in 9741us (10374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448658.635198:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788448658.637464:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826438272:12345-0@lo:400:kworker.0 Request processed in 12303us (12678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448658.637499:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448658.638311:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826438272:0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.638343:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826438784:0@lo:400:kworker.0 00010000:00080000:2.0:1788448658.638358:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bff0b800 x1875323826439296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448658.638368:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826439296:0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.638381:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826437888:0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.638391:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826438400:0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.638402:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826438912:0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.638413:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826439424:0@lo:400:kworker.0 00000100:00100000:2.0:1788448658.919547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448658.919603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448658.919641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448658.926639:0:20175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801191168 00000100:00100000:1.0:1788448658.926653:0:20175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801191168 00000100:00100000:1.0:1788448658.926714:0:20175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801191424 00000100:00100000:1.0:1788448658.926716:0:20175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801191424 00000100:00100000:1.0:1788448658.926735:0:20175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801191296 00000100:00100000:1.0:1788448658.926737:0:20175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801191296 00000100:00100000:1.0:1788448658.926755:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:1.0:1788448658.926776:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:2401:x1875323801191168:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448658.926791:0:20175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448658.926819:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fcc00/0xf45a9e4e6b804d4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a06 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448658.926836:0:20175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448658.926914:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:2401:x1875323801191168:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 139us (7377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448658.926921:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:1.0:1788448658.926938:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:1.0:1788448658.926944:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:2401:x1875323801191424:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448658.926951:0:20175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448658.926959:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a76 expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448658.926967:0:20175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448658.926981:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+9:2401:x1875323801191424:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 38us (7379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448658.926987:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:1.0:1788448658.926999:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:1.0:1788448658.927004:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+8:2401:x1875323801191296:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448658.927011:0:20175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448658.927019:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204bc00/0xf45a9e4e6b804d51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a37 expref: 8 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448658.927027:0:20175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448658.927048:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:712f63d1-2d07-4fc2-9551-3a10ea985aa1+7:2401:x1875323801191296:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 44us (7408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448658.927054:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1788448658.940301:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448658.945040:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801191680 00000100:00100000:2.0:1788448658.945058:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801191680 00000100:00100000:2.0:1788448658.945175:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:2.0:1788448658.945197:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2397:x1875323801191680:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:2.0:1788448658.945246:0:20338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804d5f 00000020:00010000:2.0:1788448658.945255:0:20338:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc1872d1800: total 0 00000100:00080000:2.0:1788448658.945260:0:20338:0:(import.c:65:import_set_state_nolock()) ffff9fc1872d0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788448658.945330:0:20338:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00100000:2.0:1788448658.945492:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2397:x1875323801191680:12345-192.168.206.21@tcp:39:umount.0 Request processed in 306us (5198us total) trans 8589934629 rc 0/0 00000100:00100000:2.0:1788448658.945501:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 69 00000020:00010000:3.0:1788448658.945645:0:19726:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc1872d1800: total 0 00010000:00010000:3.0:1788448658.945649:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448658.945702:0:19726:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc1872d1800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788448658.945739:0:19726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08319bf00) 00010000:00010000:3.0:1788448658.945742:0:19726:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448658.945751:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5e00/0xf45a9e4e6b804e54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aa0 expref: 4 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448658.945773:0:19726:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc1872d1800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788448658.945785:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448658.945787:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448658.945789:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788448658.946925:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448658.960180:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448658.960298:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801191808 00000100:00100000:2.0:1788448658.960308:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801191808 00000100:00100000:2.0:1788448658.960382:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:2.0:1788448658.960394:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2397:x1875323801191808:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:2.0:1788448658.960434:0:17146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804d66 00000100:00080000:2.0:1788448658.960443:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9fc1872d2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788448658.960475:0:17146:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788448658.960610:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+3:2397:x1875323801191808:12345-192.168.206.21@tcp:39:umount.0 Request processed in 217us (438us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788448658.960618:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 70 00010000:00010000:1.0:1788448658.960821:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788448658.961058:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448658.989156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448658.989459:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801192064 00000100:00100000:3.0:1788448658.989468:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801192064 00000100:00100000:3.0:1788448658.989564:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 175 00000100:00100000:3.0:1788448658.989575:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+7:2397:x1875323801192064:12345-192.168.206.21@tcp:251:umount.0 00000020:00000080:3.0:1788448658.989633:0:17139:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804cfd 00000020:00010000:3.0:1788448658.989642:0:17139:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc08221e800: total 0 00000100:00080000:3.0:1788448658.989646:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9fc08221f800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788448658.989724:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+3:2397:x1875323801192064:12345-192.168.206.21@tcp:251:umount.0 Request processed in 151us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448658.989732:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 175 00000020:00010000:1.0:1788448658.989785:0:17134:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc08221e800: total 0 00010000:00010000:1.0:1788448658.989841:0:17134:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc08221e800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788448658.989873:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fc600/0xf45a9e4e6b804d04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e098f expref: 2 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448658.989914:0:17134:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc08221e800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788448658.989924:0:17134:0:(genops.c:885:class_export_put()) final put ffff9fc08221e800/712f63d1-2d07-4fc2-9551-3a10ea985aa1 00010000:00010000:1.0:1788448658.989933:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448658.989935:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448658.989937:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788448658.991721:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc08221e800/712f63d1-2d07-4fc2-9551-3a10ea985aa1 for MGS 00000020:00000080:0.0:1788448658.991771:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc08221f800 for MGS 00010000:00010000:3.0:1788448659.138135:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448660.159660:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788448660.990493:0:20721:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788448661.001497:0:20721:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788448661.001560:0:20721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.002124:0:20721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.002136:0:20721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.002143:0:20721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.002231:0:20721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788448661.002238:0:20721:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788448661.002264:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448661.002268:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788448661.002273:0:20721:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788448661.002297:0:20721:0:(import.c:65:import_set_state_nolock()) ffff9fc08360a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788448661.002366:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826439808:0@lo:39:umount.0 00000100:00100000:0.0:1788448661.002435:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448661.002528:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826439808 00000100:00100000:1.0:1788448661.002535:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826439808 00000100:00100000:1.0:1788448661.002595:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788448661.002604:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875323826439808:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788448661.002628:0:17145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8048f1 00000100:00080000:1.0:1788448661.002646:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9fc08360f800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788448661.002961:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448661.002970:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.002991:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351fe00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448661.002995:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.003005:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448661.003012:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448661.003018:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788448661.003021:0:17134:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788448661.003023:0:17134:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788448661.003052:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.003059:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788448661.003116:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1788448661.003235:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.003243:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.003256:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448661.003258:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448661.003260:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448661.003339:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448661.003460:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1875323826439808:12345-0@lo:39:umount.0 Request processed in 856us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448661.003469:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1788448661.003481:0:17145:0:(genops.c:885:class_export_put()) final put ffff9fc1b7388800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788448661.003550:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b7388800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788448661.003607:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc08360f800 for lustre-MDT0000 00000100:00100000:0.0:1788448661.003836:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826439936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448661.003907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448661.004036:0:20175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826439936 00000100:00100000:1.0:1788448661.004042:0:20175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826439936 00000100:00100000:1.0:1788448661.004081:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448661.004089:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3646:x1875323826439936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448661.004109:0:20175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448661.004127:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351f800/0xf45a9e4e6b8048c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b8048c0 expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.004140:0:20175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448661.004165:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:3646:x1875323826439936:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448661.004181:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448661.004288:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826439936:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788448661.004429:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc08360a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788448661.004476:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826439808:0@lo:39:umount.0 00000100:00080000:1.0:1788448661.004518:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448661.004522:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788448661.004527:0:20721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788448661.006315:0:20721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.006333:0:20721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.006341:0:20721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.006348:0:20721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.006414:0:20721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448661.006421:0:20721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.006429:0:20721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.006435:0:20721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.006441:0:20721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.006537:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448661.006559:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.006566:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448661.006570:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.006587:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448661.006594:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448661.006600:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448661.006603:0:17133:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788448661.006640:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.006647:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448661.006679:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.006686:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.006701:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448661.006704:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.006709:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448661.006712:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.006724:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448661.006731:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448661.006737:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448661.006739:0:17133:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788448661.006750:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.006755:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448661.006773:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.006780:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448661.006782:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448661.006784:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448661.006801:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826440192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448661.006872:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448661.006974:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826440192 00000100:00100000:2.0:1788448661.006980:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826440192 00000100:00100000:2.0:1788448661.007024:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448661.007033:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:3647:x1875323826440192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448661.007044:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448661.007059:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1a0330800/0xf45a9e4e6b804c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804c1d expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.007070:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448661.007129:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:3647:x1875323826440192:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448661.007136:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448661.007191:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826440192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448661.007272:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448661.007282:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826440064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448661.007312:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448661.007434:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826440064 00000100:00100000:2.0:1788448661.007439:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826440064 00000100:00100000:2.0:1788448661.007477:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448661.007484:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0837bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:3645:x1875323826440064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448661.007491:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448661.007501:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351f000/0xf45a9e4e6b804818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804811 expref: 22 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.007510:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448661.007551:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0837bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:3645:x1875323826440064:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448661.007558:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448661.007654:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826440064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448661.007789:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448661.007826:0:20721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788448661.007833:0:20721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448661.007844:0:20721:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788448661.007853:0:20721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.007860:0:20721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.007867:0:20721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.007873:0:20721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.008025:0:20721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448661.008032:0:20721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.008040:0:20721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448661.008046:0:20721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.008052:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448661.008053:0:20721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.008058:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.008065:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448661.008068:0:19726:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.008076:0:19726:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448661.008083:0:19726:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448661.008088:0:19726:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788448661.008090:0:19726:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788448661.008092:0:19726:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788448661.008110:0:20721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788448661.008114:0:20721:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788448661.008117:0:20721:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788448661.008119:0:19726:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.008125:0:19726:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:1.0:1788448661.008145:0:20721:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00010000:00010000:3.0:1788448661.008149:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788448661.008149:0:20721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788448661.008153:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1788448661.008156:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788448661.008158:0:20721:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788448661.008163:0:20721:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc083fa6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788448661.008169:0:20721:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc0831cf000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1788448661.008171:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448661.008174:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788448661.008174:0:20721:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc1bb4c3000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788448661.008179:0:20721:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc190ac0000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1788448661.008180:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331600 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448661.008183:0:19726:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788448661.008186:0:20721:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fc1872d1800 ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 192.168.206.21@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00010000:00010000:3.0:1788448661.008190:0:19726:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788448661.008191:0:20721:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fc0831ce000 03254173-b90a-4634-8f44-6b5b52d8ff13 192.168.206.21@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934624 stale:0 10000000:00010000:3.0:1788448661.008197:0:19726:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788448661.008197:0:20721:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9fc19ebeb370) has exports, disconnecting them 00000020:00080000:1.0:1788448661.008201:0:20721:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc083fa6000), last request at 1788448658 10000000:01000000:3.0:1788448661.008203:0:19726:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788448661.008204:0:19726:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788448661.008206:0:19726:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:1.0:1788448661.008207:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804bec 00010000:00010000:3.0:1788448661.008218:0:19726:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788448661.008222:0:20721:0:(import.c:65:import_set_state_nolock()) ffff9fc083fa1000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788448661.008224:0:19726:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448661.008233:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.008240:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448661.008248:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448661.008250:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448661.008260:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826440320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448661.008300:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448661.008344:0:20174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826440320 00000100:00100000:0.0:1788448661.008349:0:20174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826440320 00000100:00100000:0.0:1788448661.008379:0:20174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788448661.008386:0:20174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:3648:x1875323826440320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448661.008395:0:20174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448661.008406:0:20174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804dcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804dc8 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448661.008415:0:20174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448661.008441:0:20174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:3648:x1875323826440320:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448661.008447:0:20174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788448661.008472:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826440320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448661.008485:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448661.008491:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826440448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448661.008517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448661.008663:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448661.008675:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826440448 00000100:00100000:2.0:1788448661.008679:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826440448 00000100:00100000:2.0:1788448661.008740:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448661.008747:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:3646:x1875323826440448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448661.008756:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448661.008765:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b80480a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804803 expref: 20 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448661.008775:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448661.008809:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:3646:x1875323826440448:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448661.008826:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:00080000:1.0:1788448661.008920:0:20721:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc083fa6000): rc 0 00000020:00000080:1.0:1788448661.008924:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc083fa6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788448661.008948:0:20721:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc0831cf000), last request at 1788448658 00000020:00000080:1.0:1788448661.008953:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804a8e 00000100:00080000:1.0:1788448661.008960:0:20721:0:(import.c:65:import_set_state_nolock()) ffff9fc0831ce800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788448661.008975:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083fa6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788448661.009015:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc083fa1000 for lustre-MDT0000 00000020:00080000:1.0:1788448661.009028:0:20721:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc0831cf000): rc 0 00000020:00000080:1.0:1788448661.009037:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc0831cf000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788448661.009045:0:20721:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc1bb4c3000), last request at 1788448579 00000020:00000080:1.0:1788448661.009049:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8049df 00000100:00080000:1.0:1788448661.009053:0:20721:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb4c6000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788448661.009063:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831cf000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788448661.009085:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0831ce800 for lustre-MDT0000 00000020:00080000:1.0:1788448661.009096:0:20721:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc1bb4c3000): rc 0 00000020:00000080:1.0:1788448661.009109:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc1bb4c3000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:3.0:1788448661.009117:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788448661.009117:0:20721:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc190ac0000), last request at 1788448579 00000020:00000080:1.0:1788448661.009121:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804976 00000100:00080000:1.0:1788448661.009124:0:20721:0:(import.c:65:import_set_state_nolock()) ffff9fc183e90800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788448661.009127:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448661.009131:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788448661.009134:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bb4c3000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788448661.009159:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1bb4c6000 for lustre-MDT0000 00000001:00000004:1.0:1788448661.009171:0:20721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934629 00000020:00080000:1.0:1788448661.009244:0:20721:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc190ac0000): rc 0 00000004:00000080:1.0:1788448661.009251:0:20721:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbf8c08597ae0 00000100:00080000:1.0:1788448661.009269:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788448661.009273:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788448661.010077:0:20721:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788448661.010110:0:20721:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788448661.010229:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826440576:0@lo:39:umount.0 00000100:00100000:3.0:1788448661.010282:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788448661.010424:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788448661.010428:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1788448661.010447:0:20721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788448661.010503:0:20721:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788448661.010515:0:20721:0:(import.c:65:import_set_state_nolock()) ffff9fc082765000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788448661.010531:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788448661.010534:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000100:00100000:3.0:1788448661.010549:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826440704:0@lo:9:umount.0 00000100:00100000:3.0:1788448661.010577:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788448661.010648:0:20721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788448661.010716:0:20721:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788448661.010726:0:20721:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788448661.010758:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826440832:0@lo:9:umount.0 00000020:00080000:1.0:1788448661.010773:0:20721:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fc19ebeb370) has no exports 00000100:00100000:3.0:1788448661.010793:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448661.010856:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826440576 00000100:00100000:0.0:1788448661.010863:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826440576 00000100:00100000:0.0:1788448661.010921:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788448661.010940:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875323826440576:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788448661.010965:0:17151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804a09 00000100:00080000:0.0:1788448661.010972:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9fc183e91000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788448661.011003:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1788448661.011123:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448661.011132:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3644:x1875323826440576:12345-0@lo:39:umount.0 Request processed in 204us (849us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788448661.011140:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788448661.011178:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788448661.011185:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826440576:0@lo:39:umount.0 00000100:00100000:1.0:1788448661.011303:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826440704 00000100:00100000:1.0:1788448661.011307:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826440704 00000100:00100000:1.0:1788448661.011353:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826440832 00000100:00100000:1.0:1788448661.011357:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826440832 00000100:00100000:3.0:1788448661.011372:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788448661.011376:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788448661.011380:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875323826440704:12345-0@lo:9:umount.0 00000100:00100000:1.0:1788448661.011382:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875323826440832:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788448661.011395:0:18651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804ad4 00000020:00000080:1.0:1788448661.011395:0:18652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804c2b 00000100:00080000:1.0:1788448661.011400:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9fc083fa7800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788448661.011401:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ea000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788448661.011434:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448661.011439:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1788448661.011444:0:18651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000001:00000004:1.0:1788448661.011481:0:18652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788448661.011538:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3644:x1875323826440704:12345-0@lo:9:umount.0 Request processed in 159us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448661.011545:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1788448661.011560:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448661.011564:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448661.011694:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3644:x1875323826440832:12345-0@lo:9:umount.0 Request processed in 311us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448661.011700:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788448661.011970:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788448661.011987:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788448661.011989:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788448661.011993:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826440832:0@lo:9:umount.0 00000100:00080000:0.0:1788448661.012006:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc082765000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788448661.012015:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788448661.012017:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788448661.012019:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826440704:0@lo:9:umount.0 00000100:00100000:2.0:1788448661.012234:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826440448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448661.012252:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788448661.019222:0:20721:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fc19ebeb370) has no exports 00000020:00000080:1.0:1788448661.063372:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80485e 00000020:00000080:1.0:1788448661.063390:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc08360b000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788448661.063448:0:20721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788448661.063557:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448661.063568:0:20721:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788448661.063572:0:20721:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9fc19ebecd28) has no exports 00000020:00000080:0.0:1788448661.063906:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804857 00000020:00000080:0.0:1788448661.063911:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc1bb72e000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788448661.064187:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc08360b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788448661.064406:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448661.064415:0:20721:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788448661.064419:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc1b5c9e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788448661.064421:0:20721:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b5c9e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788448661.064431:0:20721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788448661.064649:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bb72e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788448661.182793:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448661.694741:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788448661.697443:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448661.697466:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826440960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448661.697532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448661.698001:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826440960 00000100:00100000:3.0:1788448661.698010:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826440960 00000100:00100000:3.0:1788448661.698057:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788448661.698065:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875323826440960:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788448661.698074:0:17150:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788448661.698141:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875323826440960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (607us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788448661.698159:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:02020000:1.0:1788448661.698442:0:3645:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788448661.710909:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788448661.710917:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9fc1b0353800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788448661.710922:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788448661.729971:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9fc1b0353800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448661.729985:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 497 00000100:00080000:1.0:1788448661.729994:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc1b0353800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448661.730033:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083e4f480 x1875323826441088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448661.732448:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826441088:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788448661.732525:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448661.732950:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826441088 00000100:00100000:2.0:1788448661.732959:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826441088 00000100:00100000:2.0:1788448661.732995:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788448661.733003:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826441088:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788448661.733022:0:17150:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788448661.736559:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826441088:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 3548us (4025us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788448661.736574:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788448661.738373:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1b0353800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448661.738384:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788448661.738388:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826441088:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788448662.206274:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826441216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448662.206344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448662.206428:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448662.206507:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826441216 00000100:00100000:3.0:1788448662.206516:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826441216 00000100:00100000:3.0:1788448662.206580:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788448662.206589:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826441216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448662.206617:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788448662.206702:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826441216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448662.206710:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788448662.206762:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448662.214305:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826441216:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788448662.720851:0:17125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788448662.720862:0:17125:0:(genops.c:885:class_export_put()) final put ffff9fc190ac0000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788448662.720903:0:17125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000001:00080000:3.0:1788448662.720912:0:17125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934629 is committed 00000020:00000080:3.0:1788448662.720916:0:17125:0:(genops.c:885:class_export_put()) final put ffff9fc1872d1800/ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000001:00100000:3.0:1788448662.720921:0:17125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03254173-b90a-4634-8f44-6b5b52d8ff13 00000001:00080000:3.0:1788448662.720927:0:17125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1788448662.720933:0:17125:0:(genops.c:885:class_export_put()) final put ffff9fc0831ce000/03254173-b90a-4634-8f44-6b5b52d8ff13 00000020:00000080:2.0:1788448662.721031:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc190ac0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788448662.721082:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1872d1800/ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 for lustre-MDT0000 00000020:00000080:2.0:1788448662.721124:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831ce000/03254173-b90a-4634-8f44-6b5b52d8ff13 for lustre-MDT0000 00000020:00000080:2.0:1788448662.721158:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc183e90800 for lustre-MDT0000 00000020:00000080:2.0:1788448662.721165:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1872d0000 for lustre-MDT0000 00000020:00000080:2.0:1788448662.721171:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc187515800 for lustre-MDT0000 00000001:00100000:0.0:1788448662.721533:0:17878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788448662.721545:0:17878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1788448662.721547:0:17878:0:(genops.c:885:class_export_put()) final put ffff9fc183e93000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788448662.721566:0:17878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000001:00080000:0.0:1788448662.721571:0:17878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1788448662.721573:0:17878:0:(genops.c:885:class_export_put()) final put ffff9fc1872d3800/ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000001:00100000:0.0:1788448662.721577:0:17878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 03254173-b90a-4634-8f44-6b5b52d8ff13 00000001:00080000:0.0:1788448662.721580:0:17878:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1788448662.721582:0:17878:0:(genops.c:885:class_export_put()) final put ffff9fc1872d5800/03254173-b90a-4634-8f44-6b5b52d8ff13 00000020:00000080:2.0:1788448662.721633:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc183e93000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788448662.721672:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1872d3800/ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 for lustre-MDT0001 00000020:00000080:2.0:1788448662.721707:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1872d5800/03254173-b90a-4634-8f44-6b5b52d8ff13 for lustre-MDT0001 00000020:00000080:2.0:1788448662.721725:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc183e91000 for lustre-MDT0001 00000020:00000080:2.0:1788448662.721730:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1872d2800 for lustre-MDT0001 00000020:00000080:2.0:1788448662.721733:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1872d7800 for lustre-MDT0001 00000001:00100000:1.0:1788448662.723001:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788448662.723010:0:18646:0:(genops.c:885:class_export_put()) final put ffff9fc1873a2800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788448662.723041:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03254173-b90a-4634-8f44-6b5b52d8ff13 00000020:00000080:1.0:1788448662.723044:0:18646:0:(genops.c:885:class_export_put()) final put ffff9fc187510800/03254173-b90a-4634-8f44-6b5b52d8ff13 00000020:00000080:2.0:1788448662.723117:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1873a2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788448662.723162:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc187510800/03254173-b90a-4634-8f44-6b5b52d8ff13 for lustre-OST0000 00000020:00000080:2.0:1788448662.723184:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0835ea000 for lustre-OST0000 00000020:00000080:2.0:1788448662.723189:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1bb1e3000 for lustre-OST0000 00000020:01000000:1.0:1788448663.104113:0:20721:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc081b56cc0 - data ffff9fc1ad83c798/ffff9fc0832bb400 00000020:01000000:1.0:1788448663.104286:0:20721:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc1bb561a20 - data ffff9fc1ada73288/ffff9fc1b6516800 00000001:00000004:1.0:1788448663.111120:0:20721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934629 00000100:00080000:0.0:1788448663.160476:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788448663.160625:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788448663.160639:0:20721:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9fc083e4d880 x1875323826440576/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788448671 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448663.160661:0:20721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788448663.162761:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788448663.162767:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1788448663.162787:0:20721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788448663.162791:0:20721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788448663.165500:0:17169:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788448663.165507:0:17169:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1788448663.165522:0:17169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788448663.167201:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788448663.167207:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1788448663.167222:0:20721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788448663.167225:0:20721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788448663.172510:0:17171:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788448663.172528:0:17171:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:3.0:1788448663.172541:0:17171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788448663.175215:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804826 00000020:00000080:0.0:1788448663.175226:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc1b5c9c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788448663.179401:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80483b 00000020:00000080:0.0:1788448663.179413:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc1bb74c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788448663.179582:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b5c9c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788448663.180303:0:20721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788448663.180322:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448663.180340:0:20721:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788448663.180345:0:20721:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9fc19ebe8000) has no exports 00000004:01000000:0.0:1788448663.180551:0:20721:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788448663.180560:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80489d 00000020:00000080:0.0:1788448663.180566:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc1b5c9a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788448663.181989:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bb74c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788448663.182125:0:20721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788448663.182133:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448663.182143:0:20721:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788448663.182148:0:20721:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9fc0823d3370) has no exports 00000020:00000080:0.0:1788448663.182157:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804896 00000020:00000080:0.0:1788448663.182164:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc187ba4800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788448663.182567:0:20721:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788448663.182572:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788448663.182577:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1788448663.182584:0:20721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788448663.182841:0:20721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788448663.182905:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448663.182912:0:20721:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788448663.182919:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804888 00000020:00000080:0.0:1788448663.182925:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc083609800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788448663.182929:0:20721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788448663.182934:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448663.182937:0:20721:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788448663.182940:0:20721:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9fc1bb5399b8) has no exports 00000020:00000080:0.0:1788448663.182946:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804881 00000020:00000080:0.0:1788448663.182949:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc082761800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788448663.183541:0:20721:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788448663.183546:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788448663.183549:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1788448663.183553:0:20721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788448663.183555:0:20721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788448663.183581:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448663.183668:0:20721:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788448663.183752:0:20721:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788448663.183759:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804873 00000020:00000080:0.0:1788448663.183766:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc08360f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788448663.183771:0:20721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788448663.183775:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448663.183780:0:20721:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788448663.183783:0:20721:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9fc1bb79b370) has no exports 00000020:00000080:0.0:1788448663.183788:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80486c 00000020:00000080:0.0:1788448663.183790:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc082763000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788448663.186852:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b5c9a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788448663.186871:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc187ba4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788448663.186908:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc187ba0800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788448663.186920:0:36:0:(genops.c:885:class_export_put()) final put ffff9fc08360d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788448663.186923:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc08360d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788448663.186928:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788448663.187173:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083609800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788448663.187178:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc082761800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788448663.187182:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc082765000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788448663.187187:0:36:0:(genops.c:885:class_export_put()) final put ffff9fc08360c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788448663.187189:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc08360c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788448663.187193:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788448663.187223:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc08360f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788448663.187228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc082763000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788448663.188102:0:20721:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788448663.188108:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788448663.188124:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788448663.188131:0:20721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788448663.188190:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448663.188201:0:20721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788448663.188226:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448663.188230:0:20721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788448663.188234:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc1b5c9c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788448663.188237:0:20721:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b5c9c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788448663.188243:0:20721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788448663.188325:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804842 00000020:00000080:2.0:1788448663.188331:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc1bb74f000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788448663.188336:0:20721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788448663.188339:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448663.188344:0:20721:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788448663.188348:0:20721:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9fc19ebe99b8) has no exports 00000020:00000080:2.0:1788448663.188367:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448663.188370:0:20721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788448663.188388:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804849 00000020:00000080:2.0:1788448663.188392:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc1bb74e000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788448663.188400:0:20721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc083f6b800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788448663.188404:0:20721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc083f6b800 3 00000020:01000004:2.0:1788448663.188407:0:20721:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc083f6b800 from lustre-MDT0000 00000020:00000080:2.0:1788448663.188425:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448663.188429:0:20721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788448663.188431:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc1b5c9d000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788448663.188433:0:20721:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b5c9d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788448663.188441:0:20721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788448663.188468:0:20721:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788448663.188472:0:20721:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788448663.188475:0:20721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788448663.188477:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448663.188480:0:20721:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788448663.188491:0:20721:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9fc184e52800 943bfcb5-816e-4cdd-a66b-4e69884ef502 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788448663.188497:0:20721:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9fc1bb7999b8) has exports, disconnecting them 00000020:00080000:2.0:1788448663.188501:0:20721:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fc184e52800), last request at 1788448564 00000020:00000080:2.0:1788448663.188514:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8047ee 00000020:00010000:2.0:1788448663.188517:0:20721:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc184e52800: total 2 00000100:00080000:2.0:1788448663.188521:0:20721:0:(import.c:65:import_set_state_nolock()) ffff9fc184e53800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788448663.188535:0:20721:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc184e52800): rc 0 00000020:00080000:2.0:1788448663.188539:0:20721:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9fc1bb7999b8) has no exports 00000020:00010000:2.0:1788448663.188549:0:17133:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc184e52800: total 2 00010000:00010000:2.0:1788448663.188573:0:17133:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc184e52800, canceled 0 locks, left on hash table 13. 00000020:00000080:3.0:1788448663.188672:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1bb74e800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788448663.188689:0:36:0:(genops.c:885:class_export_put()) final put ffff9fc082760800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788448663.188691:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc082760800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788448663.188698:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788448663.188747:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bb74f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788448663.188751:0:36:0:(genops.c:885:class_export_put()) final put ffff9fc1b5c99800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788448663.188754:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b5c99800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788448663.188757:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788448663.188779:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bb74e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788448663.188839:0:17139:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fc18316d400:17139] 1 exiting: rc = 0 00000100:00100000:3.0:1788448663.188949:0:17140:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fc1ba245e00:17140] 2 exiting: rc = 0 00010000:00010000:2.0:1788448663.189188:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351e200/0xf45a9e4e6b80491b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804914 expref: 14 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189334:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804db3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804dac expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189347:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351f400/0xf45a9e4e6b804929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804922 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189357:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b804bd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804bd0 expref: 11 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189367:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fce00/0xf45a9e4e6b8047fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b8047f5 expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189390:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b804c16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804c0f expref: 9 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189401:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804a72 expref: 8 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189426:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a9e00/0xf45a9e4e6b804da5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804d9e expref: 7 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189434:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8049ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b8049c3 expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189443:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fd600/0xf45a9e4e6b804dc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804dba expref: 5 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189453:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1a0330a00/0xf45a9e4e6b804bad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804ba6 expref: 4 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189461:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fd200/0xf45a9e4e6b804a4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804a48 expref: 3 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189472:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b80490d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b804906 expref: 2 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448663.189481:0:17133:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc184e52800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788448663.189497:0:17133:0:(genops.c:885:class_export_put()) final put ffff9fc184e52800/943bfcb5-816e-4cdd-a66b-4e69884ef502 00010000:00010000:3.0:1788448663.189514:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448663.189516:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448663.189518:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788448663.189599:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc184e52800/943bfcb5-816e-4cdd-a66b-4e69884ef502 for MGS 00000020:00000080:2.0:1788448663.189632:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc184e53800 for MGS 00000100:00100000:0.0:1788448663.206260:0:17138:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fc1ba249c00:17138] 0 exiting: rc = 1 00000100:00100000:3.0:1788448663.206519:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206527:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206533:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206540:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206545:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206550:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206622:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206642:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206648:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206654:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206660:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206666:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206670:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206676:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206681:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206686:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206691:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206697:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206704:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206711:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206719:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206727:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206735:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206742:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206748:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206753:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206759:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206765:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206771:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206778:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206787:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206794:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206801:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206807:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206814:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206820:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206828:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206835:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206841:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206848:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206855:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206863:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.206876:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207208:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207216:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207224:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207231:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207239:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207245:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207252:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207262:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207270:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207278:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207285:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207292:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207299:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207305:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207313:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207319:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207327:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207333:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207340:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207347:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448663.207353:0:20721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788448663.208847:0:20721:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc1907e8ba0 - data ffff9fc1adb0e510/ffff9fc082208800 00000020:01000000:3.0:1788448663.209101:0:20721:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc081a88e40 - data ffff9fc1ad808bd0/ffff9fc183926000 00000020:00000080:3.0:1788448663.209627:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8047d2 00000020:00000080:3.0:1788448663.209636:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc083f6d000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788448663.210511:0:20721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc083f6b800 from MGS, refs=2 00000020:01000004:3.0:1788448663.210518:0:20721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc083f6b800 2 00000020:01000004:3.0:1788448663.210521:0:20721:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc083f6b800 from MGS 00000020:00000080:3.0:1788448663.210543:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448663.210550:0:20721:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788448663.210554:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc083f6e000/MGS 00000020:00000080:3.0:1788448663.210557:0:20721:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083f6e000/MGS for MGS 00000020:01000000:3.0:1788448663.210568:0:20721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788448663.210642:0:20721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788448663.210647:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448663.210652:0:20721:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788448663.210658:0:20721:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fc0835ac800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788448663.210664:0:20721:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9fc1bb538000) has exports, disconnecting them 00000020:00080000:3.0:1788448663.210669:0:20721:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fc0835ac800), last request at 1788448565 00000020:00000080:3.0:1788448663.210684:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8048d5 00000020:00080000:3.0:1788448663.210695:0:20721:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc0835ac800): rc 0 00000020:00000080:3.0:1788448663.210699:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc0835ac800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788448663.212491:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083f6d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788448663.218791:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0835ac800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788448663.219060:0:20721:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788448663.219066:0:20721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448663.219070:0:20721:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788448663.219075:0:20721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788448663.219255:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448663.219262:0:20721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788448663.219268:0:20721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc083f6b800 1 00000020:00000080:2.0:1788448663.219274:0:20721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8047c4 00000020:00000080:2.0:1788448663.219282:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc083f6f800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788448663.219287:0:20721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788448663.219293:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448663.219296:0:20721:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788448663.219300:0:20721:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9fc1bb798000) has no exports 00000020:00000080:0.0:1788448663.219460:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc08360a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788448663.219468:0:37:0:(genops.c:885:class_export_put()) final put ffff9fc1ba2d8800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788448663.219471:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba2d8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788448663.219476:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788448663.219549:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083f6f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788448663.297700:0:20721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448663.297713:0:20721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788448663.297719:0:20721:0:(genops.c:885:class_export_put()) final put ffff9fc083f69000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788448663.297724:0:20721:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083f69000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788448663.297736:0:20721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788448663.297863:0:20721:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc083f6d800 00000020:02000400:0.0:1788448663.298504:0:20721:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788448663.299041:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448663.743432:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826441344:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788448663.743542:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788448663.743547:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788448663.743551:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc1b0353800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448663.743557:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 579 00000100:00080000:3.0:1788448663.743562:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788448663.743568:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc1b0353800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448663.743590:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bff60380 x1875323826441600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788448663.743618:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448663.743697:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826441472:0@lo:400:kworker.0 00000100:00100000:0.0:1788448663.743716:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826441600:0@lo:38:kworker.0 00000400:00000100:3.0:1788448663.743725:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875323826441472 offset 0 length 224: 4 00000100:00100000:0.0:1788448663.743759:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448663.743763:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826442112:0@lo:400:kworker.0 00000100:00100000:3.0:1788448663.743799:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448663.743804:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826441600 00000100:00100000:0.0:1788448663.743811:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826441600 00000100:00100000:3.0:1788448663.743828:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788448663.743836:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826441728:0@lo:400:kworker.0 00000100:00100000:0.0:1788448663.743848:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788448663.743858:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826441600:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788448663.743865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1788448663.743903:0:17151:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788448663.743907:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826442240:0@lo:400:kworker.0 00000100:00100000:3.0:1788448663.743945:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448663.743975:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826441728 00000100:00100000:3.0:1788448663.743979:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826441728 00000100:00100000:3.0:1788448663.744011:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448663.744019:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826441728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448663.744066:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826441728:12345-0@lo:400:kworker.0 Request processed in 48us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448663.744074:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448663.744128:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826441728:0@lo:400:kworker.0 00000100:00100000:2.0:1788448663.744248:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826441984:0@lo:400:kworker.0 00000100:00100000:2.0:1788448663.744274:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448663.744298:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826442496:0@lo:400:kworker.0 00000100:00100000:2.0:1788448663.744316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448663.744333:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788448663.744338:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826441856:0@lo:400:kworker.0 00000100:00100000:2.0:1788448663.744356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448663.744371:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826442368:0@lo:400:kworker.0 00000100:00100000:2.0:1788448663.744386:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448663.744416:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826441344 00000100:00100000:2.0:1788448663.744420:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826441344 00000100:00100000:2.0:1788448663.744454:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448663.744460:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826441344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448663.744480:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788448663.744970:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826441344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 508us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448663.744977:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448663.745019:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826442112 00000100:00100000:2.0:1788448663.745023:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826442112 00000100:00100000:2.0:1788448663.745039:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826442240 00000100:00100000:2.0:1788448663.745042:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826442240 00000100:00100000:2.0:1788448663.745054:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826441984 00000100:00100000:2.0:1788448663.745057:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826441984 00000100:00100000:2.0:1788448663.745064:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826442496 00000100:00100000:2.0:1788448663.745066:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826442496 00000100:00100000:2.0:1788448663.745101:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826442368 00000100:00100000:2.0:1788448663.745105:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826442368 00000100:00100000:2.0:1788448663.745114:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788448663.745121:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826442240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448663.745176:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826442240:12345-0@lo:400:kworker.0 Request processed in 56us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448663.745182:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788448663.745193:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788448663.745198:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826442496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448663.745222:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826442496:12345-0@lo:400:kworker.0 Request processed in 23us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448663.745227:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788448663.745237:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788448663.745241:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875323826442112:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788448663.745246:0:20338:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788448663.745265:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875323826442112:12345-0@lo:400:kworker.0 Request processed in 23us (1468us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788448663.745271:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788448663.745280:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788448663.745283:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1875323826441984:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788448663.745288:0:20338:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788448663.745303:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1875323826441984:12345-0@lo:400:kworker.0 Request processed in 19us (1029us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788448663.745309:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788448663.745317:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788448663.745321:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1875323826442368:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788448663.745325:0:20338:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788448663.745352:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1875323826442368:12345-0@lo:400:kworker.0 Request processed in 29us (964us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788448663.745358:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788448663.745386:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826441856 00000100:00100000:2.0:1788448663.745390:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826441856 00000100:00100000:2.0:1788448663.745411:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788448663.745417:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826441856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448663.745444:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826441856:12345-0@lo:400:kworker.0 Request processed in 28us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448663.745449:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788448663.745468:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448663.745472:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788448663.746255:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9fc1b6563100 x1875323826442240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448663.746269:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826442240:0@lo:400:kworker.0 00000100:00080000:2.0:1788448663.746285:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788448663.746289:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ec000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788448663.746293:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788448663.776077:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826441600:12345-0@lo:38:kworker.0 Request processed in 32211us (32310us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788448663.776102:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788448663.777036:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826441856:0@lo:400:kworker.0 00000100:00080000:0.0:1788448663.777052:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788448663.777057:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9fc187bf5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788448663.777060:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788448663.777066:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9fc187bf5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448663.777070:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 529 00000100:00080000:0.0:1788448663.777077:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc187bf5800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448663.777120:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bff0b100 x1875323826442624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448663.777138:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826442368:0@lo:400:kworker.0 00000100:00080000:0.0:1788448663.777152:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788448663.777155:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9fc187400000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788448663.777158:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788448663.777161:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9fc187400000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448663.777164:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 497 00000100:00080000:0.0:1788448663.777168:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fc187400000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448663.777179:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bff09880 x1875323826442752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448663.777189:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826441984:0@lo:400:kworker.0 00010000:00080000:0.0:1788448663.777212:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9fc1b6560380 x1875323826442496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448663.777222:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826442496:0@lo:400:kworker.0 00000100:00100000:0.0:1788448663.777241:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826441344:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788448663.778482:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1b0353800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448663.778491:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788448663.778495:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826441600:0@lo:38:kworker.0 00000100:00100000:1.0:1788448663.778520:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826442624:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788448663.778581:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448663.778923:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826442752:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788448663.778949:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448663.779044:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826442624 00000100:00100000:0.0:1788448663.779051:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826442624 00000100:00100000:0.0:1788448663.779152:0:20338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826442752 00000100:00100000:0.0:1788448663.779158:0:20338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826442752 00000100:00100000:0.0:1788448663.779182:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788448663.779189:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875323826442624:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788448663.779209:0:20338:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788448663.779954:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875323826442624:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 762us (1370us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788448663.779973:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788448663.779995:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788448663.779999:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875323826442752:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788448663.780011:0:20338:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788448663.780040:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875323826442752:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 40us (1091us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788448663.780046:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788448663.783776:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187400000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448663.783994:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788448663.784001:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826442752:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788448663.784042:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187bf5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448663.784046:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788448663.784049:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826442624:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788448663.794824:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788448663.794837:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 512 00000100:00080000:2.0:1788448663.794848:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc0835ec000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448663.794933:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1ba34ea00 x1875323826442880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788448663.794975:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826442112:0@lo:400:kworker.0 00000100:00100000:3.0:1788448663.794999:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826442880:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788448663.795069:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448663.795422:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826442880 00000100:00100000:2.0:1788448663.795437:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826442880 00000100:00100000:2.0:1788448663.795534:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788448663.795542:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826442880:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788448663.795563:0:17147:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788448663.795610:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826442880:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 67us (541us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788448663.795618:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788448663.799243:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ec000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448663.799255:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788448663.799261:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826442880:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1788448664.322144:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448665.342488:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448666.367231:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788448666.816783:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788448666.816793:0:19465:0:(genops.c:885:class_export_put()) final put ffff9fc083fa0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788448666.816817:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083fa0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788448666.816866:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc083fa7800 for lustre-OST0001 00000020:01000004:2.0:1788448666.847233:0:20921:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788448666.862972:0:20921:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788448666.863029:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.863043:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.863063:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.863082:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.863104:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788448666.863109:0:20921:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788448666.863137:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788448666.863141:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788448666.863148:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788448666.863155:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9fc187400000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788448666.863161:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788448666.863163:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788448666.863167:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788448666.863699:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448666.863707:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448666.863716:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152ee00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448666.863719:0:19726:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448666.863729:0:19726:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448666.863736:0:19726:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448666.863743:0:19726:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788448666.863745:0:19726:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788448666.863748:0:19726:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788448666.863788:0:19726:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448666.863794:0:19726:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448666.863819:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448666.863825:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448666.863839:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448666.863841:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448666.863843:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448666.863897:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826443008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448666.865859:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.865876:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.865909:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.865915:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.865933:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448666.865953:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.865960:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.865966:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.865971:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.865984:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788448666.865990:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.865997:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.866003:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.866009:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.866021:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788448666.866026:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.866033:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.866046:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.866052:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.866060:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788448666.866064:0:20921:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788448666.866106:0:20921:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788448666.866110:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788448666.866114:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448666.866119:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788448666.866126:0:20921:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fc182d6b000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788448666.866131:0:20921:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fc0835e8800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788448666.866135:0:20921:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9fc0823d0000) has exports, disconnecting them 00000020:00080000:0.0:1788448666.866140:0:20921:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fc182d6b000), last request at 1788448663 00000020:00000080:0.0:1788448666.866146:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804c01 00000100:00080000:0.0:1788448666.866163:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9fc1b738b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788448666.866207:0:20921:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc182d6b000): rc 0 00000020:00000080:0.0:1788448666.866210:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc182d6b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788448666.866320:0:20921:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fc0835e8800), last request at 1788448663 00000020:00000080:0.0:1788448666.866325:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804aa3 00000100:00080000:0.0:1788448666.866336:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ed800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788448666.866344:0:20921:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc0835e8800): rc 0 00000020:00000080:0.0:1788448666.866346:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc0835e8800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788448666.866354:0:20921:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbf8c016a7ae0 00000100:00080000:0.0:1788448666.866371:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788448666.866385:0:20921:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9fc1bff62a00 x1875323826440960/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788448677 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448666.866395:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788448666.866748:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448666.866800:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826440960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448666.866860:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826443008 00000100:00100000:1.0:1788448666.866869:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826443008 00000100:00100000:1.0:1788448666.866922:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448666.866930:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1875323826443008:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788448666.866938:0:17130:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448666 with bad export cookie 17607559752806582254 00000100:00080000:0.0:1788448666.868044:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788448666.868052:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9fc1b0353800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:0.0:1788448666.868118:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc182d6b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788448666.868176:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0835e8800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788448666.868199:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1b738b800 for lustre-MDT0001 00010000:00010000:2.0:1788448666.868204:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00000080:0.0:1788448666.868205:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0835ed800 for lustre-MDT0001 00010000:00010000:2.0:1788448666.868216:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448666.868226:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330600 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448666.868231:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448666.868241:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448666.868248:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448666.868255:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448666.868258:0:17133:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1788448666.868261:0:17133:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1788448666.868301:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448666.868323:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448666.868493:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788448666.868499:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.868507:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448666.868510:0:19726:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.868519:0:19726:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448666.868525:0:19726:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448666.868530:0:19726:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788448666.868532:0:19726:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788448666.868534:0:19726:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788448666.868560:0:19726:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.868566:0:19726:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448666.869059:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869066:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869095:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448666.869099:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869105:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e5800 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448666.869108:0:19726:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869115:0:19726:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448666.869121:0:19726:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448666.869126:0:19726:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788448666.869129:0:19726:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788448666.869131:0:19726:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788448666.869147:0:19726:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869153:0:19726:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448666.869171:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869178:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869199:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448666.869202:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869207:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448666.869210:0:19726:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869368:0:19726:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448666.869375:0:19726:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448666.869380:0:19726:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788448666.869382:0:19726:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788448666.869385:0:19726:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788448666.869401:0:19726:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869483:0:19726:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448666.869491:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869498:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448666.869512:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448666.869514:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448666.869522:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448666.869660:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826443520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448666.869859:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448666.869928:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448666.869935:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826443392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448666.869958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448666.869994:0:20175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826443520 00000100:00100000:0.0:1788448666.870002:0:20175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826443520 00000100:00100000:0.0:1788448666.870032:0:20175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826443392 00000100:00100000:0.0:1788448666.870034:0:20175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826443392 00000100:00100000:0.0:1788448666.870047:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448666.870055:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1875323826443520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788448666.870062:0:20175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448666 with bad export cookie 17607559752806582254 00000100:00100000:0.0:1788448666.870120:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1875323826443520:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (260us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788448666.870126:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448666.870142:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788448666.870146:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1875323826443392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788448666.870151:0:20175:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448666 with bad export cookie 17607559752806582254 00000100:00100000:0.0:1788448666.870175:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1875323826443392:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (216us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788448666.870181:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788448666.870325:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788448666.870330:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9fc184e54000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788448666.870334:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788448666.872389:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448666.872522:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448666.872540:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448666.872542:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448666.872545:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448666.874986:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448666.884501:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1875323826443008:12345-0@lo:103:ldlm_bl.0 Request processed in 17565us (17748us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788448666.884515:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788448666.884784:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788448666.884789:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788448666.884799:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788448666.884866:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788448666.884935:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9fc185684000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788448666.884948:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788448666.884951:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788448666.884959:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788448666.885027:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788448666.885036:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788448666.885089:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9fc0823d0000) has no exports 00000100:00100000:3.0:1788448666.885243:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826443648:0@lo:9:umount.0 00000100:00100000:3.0:1788448666.885292:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448666.885341:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826443776:0@lo:9:umount.0 00000100:00100000:3.0:1788448666.885362:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448666.885395:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826443648 00000100:00100000:3.0:1788448666.885402:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826443648 00000100:00100000:3.0:1788448666.885447:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826443776 00000100:00100000:3.0:1788448666.885451:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826443776 00000100:00100000:3.0:1788448666.885472:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788448666.885481:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875323826443648:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788448666.885503:0:19178:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804acd 00000100:00080000:3.0:1788448666.885519:0:19178:0:(import.c:65:import_set_state_nolock()) ffff9fc0834fe000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788448666.885556:0:19178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788448666.885681:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3644:x1875323826443648:12345-0@lo:9:umount.0 Request processed in 200us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448666.885688:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788448666.885702:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788448666.885709:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875323826443776:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788448666.885720:0:19178:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804c32 00000100:00080000:3.0:1788448666.885725:0:19178:0:(import.c:65:import_set_state_nolock()) ffff9fc083fa3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788448666.886148:0:19178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:2.0:1788448666.887899:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448666.887910:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448666.887975:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3644:x1875323826443776:12345-0@lo:9:umount.0 Request processed in 2260us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448666.887988:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788448666.888054:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc185684000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788448666.888086:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788448666.888088:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788448666.888093:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826443648:0@lo:9:umount.0 00000100:00080000:3.0:1788448666.888109:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788448666.888121:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788448666.888122:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788448666.888125:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826443776:0@lo:9:umount.0 00010000:00010000:3.0:1788448666.888163:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448666.888170:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788448666.904263:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.121@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788448666.904268:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788448666.904291:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bff62300 x1875323826441472/t0(0) o400->MGC192.168.206.121@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788448679 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448666.904305:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc083e4d880 x1875323826443008/t0(0) o103->MGC192.168.206.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788448682 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448666.904313:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bff0bb80 x1875323826443520/t0(0) o103->MGC192.168.206.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788448682 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448666.904322:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bff0a300 x1875323826443392/t0(0) o103->MGC192.168.206.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788448682 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448666.904352:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:0:1875323826443264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448666.904379:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448666.904769:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:0:1875323826443136:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1788448666.904932:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788448666.904935:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788448666.904937:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788448666.904940:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9fc184e54000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448666.905011:0:3648:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 482 00000100:00080000:0.0:1788448666.905019:0:3648:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import ffff9fc184e54000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448666.905088:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826443008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448666.905102:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826441472:0@lo:400:kworker.0 00000100:00100000:0.0:1788448666.905104:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bff08380 x1875323826443904/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448666.905135:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826443520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448666.905152:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826443392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448666.905240:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:943bfcb5-816e-4cdd-a66b-4e69884ef502:3644:1875323826443904:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788448666.905285:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875323826443904 offset 0 length 520: 4 00000020:00080000:3.0:1788448666.926543:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9fc0823d0000) has no exports 00000020:01000000:2.0:1788448666.978623:0:20921:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc18316b840 - data ffff9fc198204bd0/ffff9fc0810dc800 00000020:01000000:2.0:1788448666.978821:0:20921:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc1b4910600 - data ffff9fc1ad81b0d8/ffff9fc1b007c000 00000001:00000004:2.0:1788448666.997758:0:20921:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788448667.078367:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448667.078378:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788448667.078386:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788448667.089286:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788448667.089294:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788448667.089315:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788448667.089318:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788448667.092900:0:17886:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788448667.092908:0:17886:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1788448667.092924:0:17886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788448667.093669:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788448667.093675:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788448667.093695:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788448667.093698:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788448667.096591:0:17888:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788448667.096599:0:17888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788448667.096624:0:17888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788448667.104355:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804937 00000020:00000080:1.0:1788448667.104367:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc0831c9000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788448667.104981:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80494c 00000020:00000080:1.0:1788448667.104988:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc083575800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788448667.104992:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788448667.104997:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448667.105006:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788448667.105022:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9fc0823d4d28) has no exports 00000004:01000000:1.0:1788448667.105200:0:20921:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788448667.105209:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8049a0 00000020:00000080:1.0:1788448667.105214:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc1ba062000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788448667.105218:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788448667.105222:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448667.105226:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788448667.105229:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9fc1aeb499b8) has no exports 00000020:00000080:1.0:1788448667.105234:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804999 00000020:00000080:1.0:1788448667.105236:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc1ba061000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788448667.105572:0:20921:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788448667.105577:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788448667.105581:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788448667.105586:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788448667.105588:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788448667.105615:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448667.105621:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788448667.105625:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80498b 00000020:00000080:1.0:1788448667.105629:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc1ba063800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788448667.105633:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788448667.105636:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448667.105639:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788448667.105641:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9fc1aeb4cd28) has no exports 00000020:00000080:1.0:1788448667.105645:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804984 00000020:00000080:1.0:1788448667.105647:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc185686000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788448667.105976:0:20921:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788448667.105980:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788448667.105982:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788448667.105986:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788448667.105988:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788448667.106008:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448667.106012:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788448667.106029:0:20921:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788448667.106034:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80496f 00000020:00000080:1.0:1788448667.106038:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc1bb4c7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788448667.106043:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788448667.106045:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448667.106049:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788448667.106051:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9fc1aeb4b370) has no exports 00000020:00000080:1.0:1788448667.106055:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804968 00000020:00000080:1.0:1788448667.106057:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc1b0351800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788448667.106940:0:20921:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788448667.106946:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788448667.106949:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788448667.106959:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788448667.106994:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448667.107002:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788448667.107014:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831c9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788448667.107034:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083575800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1788448667.107041:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba062000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788448667.107048:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba061000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788448667.107051:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448667.107054:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc190ac4000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788448667.107057:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788448667.107062:0:36:0:(genops.c:885:class_export_put()) final put ffff9fc1ba062800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788448667.107063:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc0831cd000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788448667.107078:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba062800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788448667.107083:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788448667.107098:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831cd000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788448667.107107:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788448667.107179:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba063800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788448667.107187:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc185686000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788448667.107194:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc185684000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788448667.107198:0:36:0:(genops.c:885:class_export_put()) final put ffff9fc190ac3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788448667.107200:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc190ac3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788448667.107204:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788448667.107252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bb4c7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788448667.107261:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b0351800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788448667.107266:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1b0353800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788448667.107271:0:36:0:(genops.c:885:class_export_put()) final put ffff9fc0831ca000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788448667.107273:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831ca000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788448667.107285:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788448667.107300:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804953 00000020:00000080:0.0:1788448667.107307:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc083573000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788448667.107319:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788448667.107344:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448667.107351:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788448667.107354:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9fc19138b370) has no exports 00000020:00000080:2.0:1788448667.107362:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083573000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788448667.107383:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448667.107389:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788448667.107392:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc083571800/lustre-MDD0001_UUID 00000020:00000080:0.0:1788448667.107394:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083571800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788448667.107398:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788448667.107508:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80495a 00000020:00000080:0.0:1788448667.107514:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc083574800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788448667.107528:0:20921:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc187ba7000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788448667.107532:0:20921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc187ba7000 2 00000020:00000080:2.0:1788448667.107534:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083574800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:0.0:1788448667.107536:0:20921:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc187ba7000 from lustre-MDT0001 00000020:00000080:0.0:1788448667.107557:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448667.107561:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788448667.107564:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc0831cb000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788448667.107566:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831cb000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788448667.107573:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788448667.107598:0:20921:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788448667.107602:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788448667.107605:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448667.107609:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788448667.107615:0:20921:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9fc187405000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788448667.107629:0:20921:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9fc1aeb48000) has exports, disconnecting them 00000020:00080000:0.0:1788448667.107634:0:20921:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9fc187405000), last request at 1788448579 00000020:00000080:0.0:1788448667.107638:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8049d8 00000020:00080000:0.0:1788448667.107659:0:20921:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc187405000): rc 0 00000020:00000080:0.0:1788448667.107663:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc187405000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788448667.107698:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc187405000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788448667.124943:0:20921:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788448667.124951:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448667.124955:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788448667.124963:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788448667.124995:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc187400000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788448667.125168:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448667.125177:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788448667.125184:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc190ac6000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788448667.125187:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc190ac6000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788448667.125193:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788448667.125264:0:20921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc187ba7000 1 00000020:00000080:2.0:1788448667.125270:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8048ff 00000020:00000080:2.0:1788448667.125275:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc182d69800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788448667.125284:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788448667.125291:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc182d69800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788448667.125301:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448667.125305:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788448667.125309:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9fc0823d19b8) has no exports 00000020:00000080:2.0:1788448667.158312:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448667.158328:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788448667.158334:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc187ba5800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788448667.158339:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc187ba5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788448667.158352:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788448667.158478:0:20921:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc187ba7800 00000020:01000000:2.0:1788448667.158497:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788448667.158522:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448667.158527:0:20921:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788448667.158531:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9fc1bb79cd28) has no exports 00000100:00100000:3.0:1788448667.165246:0:20338:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9fc1bff0d800:20338] 4 exiting: rc = 0 00000100:00100000:0.0:1788448667.165246:0:19479:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9fc0832c0200:19479] 3 exiting: rc = 0 00000100:00100000:2.0:1788448667.165487:0:17145:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9fc19f417800:17145] 0 exiting: rc = 1 00000100:00100000:0.0:1788448667.169980:0:17147:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9fc19f416c00:17147] 2 exiting: rc = 0 00000100:00100000:1.0:1788448667.173557:0:17146:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9fc19f416a00:17146] 1 exiting: rc = 0 00000100:00100000:1.0:1788448667.173925:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.173933:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.173938:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174011:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174019:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174025:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174029:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174034:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174039:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174044:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174049:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174054:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174060:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174077:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174083:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174089:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174095:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174101:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174106:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174111:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174117:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174122:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174127:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174133:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174155:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174160:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174165:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174170:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174176:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174181:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174185:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174191:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174196:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174201:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174206:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174211:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174217:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174222:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174228:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174233:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174237:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174243:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174249:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174255:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174260:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174265:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174271:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174277:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174283:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174288:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174293:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174298:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174302:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174308:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174312:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174317:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174322:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174328:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174352:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174363:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174369:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174375:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174380:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.174386:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448667.182452:0:17148:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fc1b5a0e000:17148] 0 exiting: rc = 1 00000100:00100000:2.0:1788448667.183202:0:17149:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fc1b5a0e800:17149] 1 exiting: rc = 0 00000100:00100000:1.0:1788448667.183365:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183374:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183382:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183386:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183391:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183396:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183400:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183405:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183409:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183415:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183419:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183423:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183428:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183433:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183438:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183443:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183448:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183453:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183458:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183463:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183470:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183475:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183480:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183485:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183490:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183495:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183501:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183506:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183511:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183516:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183530:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183535:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183540:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183545:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183550:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183555:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183560:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183564:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183689:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183695:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183700:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183705:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183710:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183714:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183720:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183726:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183731:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183736:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183741:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183745:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183813:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183821:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183826:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183832:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183837:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183842:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183847:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183852:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183857:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183862:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183867:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183872:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183877:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.183908:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.184371:0:17151:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9fc1ba2c8600:17151] 1 exiting: rc = 0 00000100:00100000:2.0:1788448667.184503:0:17150:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9fc18307a400:17150] 0 exiting: rc = 1 00000100:00100000:1.0:1788448667.184684:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.184693:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.184698:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.184705:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.184710:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.184716:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.184722:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.184727:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.184734:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.184740:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.184746:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185082:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185092:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185112:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185118:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185124:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185130:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185136:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185141:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185147:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185153:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185159:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185166:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185171:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185178:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185196:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185202:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185208:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185214:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185220:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185226:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185233:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185240:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185246:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185251:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185265:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185271:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185289:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185296:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185302:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185308:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185313:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185319:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185324:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185329:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185336:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185342:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185349:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185355:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185372:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185379:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185385:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185391:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185398:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185403:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185409:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185415:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185421:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185426:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185431:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185437:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185443:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185449:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.185455:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.195221:0:17152:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fc1ba2c9a00:17152] 0 exiting: rc = 1 00000100:00100000:2.0:1788448667.195406:0:17153:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fc1ba2c9400:17153] 1 exiting: rc = 0 00000100:00100000:1.0:1788448667.195498:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195505:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195510:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195516:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195521:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195526:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195544:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195549:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195554:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195559:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195564:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195698:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195704:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195709:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195714:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195719:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195724:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195730:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195734:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195739:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195744:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195748:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195828:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195832:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195837:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195842:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195846:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195851:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195855:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195860:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195865:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195870:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195875:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195913:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195920:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195925:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195929:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195934:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.195939:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196039:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196045:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196060:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196075:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196081:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196086:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196090:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196096:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196100:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196104:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196109:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196114:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196118:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196123:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196128:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196132:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196137:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196141:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196146:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196149:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196154:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196158:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196162:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196167:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.196171:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.197226:0:17155:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fc1ba2c9200:17155] 1 exiting: rc = 0 00000100:00100000:2.0:1788448667.197377:0:17154:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fc1ba2c8400:17154] 0 exiting: rc = 1 00000100:00100000:0.0:1788448667.197468:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197475:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197480:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197485:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197490:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197495:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197500:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197505:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197511:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197517:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197522:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197526:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197531:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197536:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197541:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197545:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197550:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197555:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197560:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197678:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197686:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197692:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197697:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197701:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197717:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197722:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197726:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197731:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197735:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197740:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197744:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197811:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197819:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197824:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197829:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197833:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197837:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197842:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197847:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197851:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197855:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197860:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197865:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197869:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197874:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197908:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197916:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197921:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197925:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197930:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197934:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197938:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197952:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197957:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197963:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197968:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197973:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197977:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197982:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.197995:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198000:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198005:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198010:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198015:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.198442:0:17156:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fc1ba2c8800:17156] 0 exiting: rc = 1 00000100:00100000:2.0:1788448667.198562:0:17157:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fc18307a600:17157] 1 exiting: rc = 0 00000100:00100000:0.0:1788448667.198836:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198842:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198847:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198851:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198856:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198861:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198865:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198869:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.198874:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199007:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199016:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199021:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199027:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199032:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199037:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199042:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199046:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199052:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199056:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199061:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199076:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199083:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199088:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199092:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199097:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199102:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199107:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199111:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199116:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199120:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199136:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199141:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199147:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199152:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199158:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199163:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199169:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199174:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199179:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199184:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199189:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199194:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199199:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199204:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199209:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199213:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199219:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199223:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199228:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199233:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199238:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199242:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199247:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199252:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199257:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199262:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199267:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199272:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199277:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199282:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199286:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199291:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199296:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.199300:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448667.201119:0:17159:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9fc083effa00:17159] 1 exiting: rc = 0 00000100:00100000:2.0:1788448667.201389:0:17158:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9fc083eff400:17158] 0 exiting: rc = 1 00000100:00100000:3.0:1788448667.201725:0:17160:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9fc083effe00:17160] 2 exiting: rc = 0 00000100:00100000:1.0:1788448667.202395:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202404:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202409:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202414:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202419:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202429:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202435:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202445:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202450:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202458:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202473:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202478:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202485:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202500:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202507:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202512:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202517:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202521:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202526:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202532:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202537:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202542:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202548:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202553:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202558:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202563:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202698:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202706:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202711:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202717:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202723:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202728:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202733:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202739:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202744:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202822:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202831:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202854:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202861:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202867:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202872:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202877:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.202938:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.204526:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.204543:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.204561:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205131:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205140:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205145:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205150:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205155:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205161:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205168:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205175:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205180:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205184:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205190:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205196:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205201:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205207:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205214:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205221:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205228:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448667.205249:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788448667.212243:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448667.212257:0:20921:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788448667.212262:0:20921:0:(genops.c:885:class_export_put()) final put ffff9fc1ba2dd800/MDS_uuid 00000020:00000080:0.0:1788448667.212266:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba2dd800/MDS_uuid for MDS 00000020:01000000:0.0:1788448667.212271:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788448667.212403:0:20921:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788448667.393928:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448668.415938:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788448668.862038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788448668.862049:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448668.862052:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788448668.862068:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788448668.862072:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448668.862080:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 581 00000100:00080000:3.0:1788448668.862085:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788448668.862092:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc0835ec000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448668.862134:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1b6561c00 x1875323826444032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448668.862186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788448668.862190:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788448668.862192:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc187bf5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448668.862195:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 581 00000100:00080000:3.0:1788448668.862198:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788448668.862201:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc187bf5800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448668.862213:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1b6561f80 x1875323826444288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448668.862263:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826444416:0@lo:400:kworker.0 00000400:00000100:3.0:1788448668.862317:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826444416 offset 0 length 224: 4 00000100:00100000:2.0:1788448668.862427:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448668.862438:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826444160:0@lo:400:kworker.0 00000400:00000100:2.0:1788448668.862465:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826444160 offset 0 length 224: 4 00000100:00100000:1.0:1788448668.862513:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826444032:0@lo:38:kworker.0 00000400:00000100:1.0:1788448668.862540:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826444032 offset 0 length 520: 4 00000100:00100000:1.0:1788448668.862553:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826444288:0@lo:38:kworker.0 00000400:00000100:1.0:1788448668.862567:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826444288 offset 0 length 520: 4 00010000:00010000:3.0:1788448669.442254:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448670.465934:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448671.488998:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788448671.793497:0:21123:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788448671.822525:0:21123:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788448671.822574:0:21123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448671.822586:0:21123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448671.822594:0:21123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448671.822601:0:21123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448671.822624:0:21123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788448671.822629:0:21123:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788448671.822654:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788448671.822666:0:21123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1b6561c00 x1875323826444032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788448683 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448671.822691:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788448671.822698:0:21123:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788448671.822704:0:21123:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ec000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788448671.822708:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788448671.822712:0:21123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1b6561c00 x1875323826444032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788448683 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448671.822718:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788448671.822722:0:21123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:2.0:1788448671.823133:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448671.823142:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448671.823149:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351ee00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448671.823153:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448671.823162:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448671.823169:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448671.823174:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448671.823189:0:17133:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788448671.823191:0:17133:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788448671.823204:0:17133:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc184e54000 00010000:00010000:2.0:1788448671.823208:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448671.823214:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448671.823225:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448671.823227:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448671.823229:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448671.823553:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826444032:0@lo:38:kworker.0 00000100:00080000:2.0:1788448671.825553:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788448671.825569:0:21123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1b6560000 x1875323826444160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448684 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448671.825642:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788448671.825650:0:21123:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788448671.825677:0:21123:0:(import.c:65:import_set_state_nolock()) ffff9fc0835e9000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788448671.825757:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875323826444544:0@lo:39:umount.0 00000400:00000100:1.0:1788448671.825822:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826444544 offset 0 length 224: 4 00000100:00100000:0.0:1788448671.826403:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826444160:0@lo:400:kworker.0 00000100:00080000:0.0:1788448671.872197:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448671.872208:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448671.872211:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448671.872214:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788448671.872358:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448671.872384:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826444672:0@lo:400:kworker.0 00000400:00000100:2.0:1788448671.872448:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826444672 offset 0 length 224: 4 00000001:00100000:3.0:1788448672.453168:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788448672.453176:0:18646:0:(genops.c:885:class_export_put()) final put ffff9fc0834fe800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788448672.453487:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788448672.453492:0:19465:0:(genops.c:885:class_export_put()) final put ffff9fc083fa4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788448672.453526:0:16256:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0834fe800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788448672.453581:0:16256:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0834fe000 for lustre-OST0000 00000020:00000080:2.0:1788448672.455287:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083fa4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788448672.455364:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc083fa3000 for lustre-OST0001 00010000:00010000:2.0:1788448672.513013:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448673.538638:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788448673.920147:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788448673.920172:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448673.920175:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788448673.920179:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448673.920296:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448673.920329:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826444800:0@lo:400:kworker.0 00000400:00000100:3.0:1788448673.920382:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826444800 offset 0 length 224: 4 00010000:00010000:2.0:1788448674.558285:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448675.582113:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448676.606410:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448676.930230:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448666/real 1788448666] req@ffff9fc1bff08380 x1875323826443904/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788448676 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448676.930262:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc1bff08380 x1875323826443904/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788448676 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788448676.930282:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc184e54000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448676.930366:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788448676.930371:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:943bfcb5-816e-4cdd-a66b-4e69884ef502:3644:1875323826443904:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788448676.930504:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788448676.930509:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788448676.930512:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc184e54000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788448676.930533:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 584 00000100:00080000:2.0:1788448676.930537:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.121@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788448676.930543:0:36:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import ffff9fc184e54000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448676.930570:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1ba34f100 x1875323826444928/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448676.930622:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:943bfcb5-816e-4cdd-a66b-4e69884ef502:3644:1875323826444928:0@lo:250:kworker.0 00000400:00000100:1.0:1788448676.930667:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875323826444928 offset 0 length 520: 4 00000100:00080000:2.0:1788448676.930792:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788448676.930797:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448676.930901:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826445056:0@lo:400:kworker.0 00000400:00000100:3.0:1788448676.930936:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826445056 offset 0 length 224: 4 00010000:00010000:2.0:1788448677.630061:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448678.655283:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448679.681433:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448680.702147:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448681.023621:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448671/real 1788448671] req@ffff9fc1ba34c700 x1875323826444544/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448681 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448681.023653:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc1ba34c700 x1875323826444544/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448681 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788448681.023671:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0835e9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788448681.023691:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875323826444544:0@lo:39:umount.0 00000100:00080000:2.0:1788448681.024778:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788448681.024786:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788448681.024794:0:21123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788448681.025667:0:21123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.025696:0:21123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.025704:0:21123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.025710:0:21123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.025744:0:21123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448681.025752:0:21123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.025778:0:21123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.025784:0:21123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.025790:0:21123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.025808:0:21123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788448681.025813:0:21123:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788448681.025835:0:21123:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788448681.025838:0:21123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788448681.025843:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448681.025848:0:21123:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788448681.025853:0:21123:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9fc1bb53b370) has no exports 00010000:00010000:0.0:1788448681.025868:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:2.0:1788448681.025876:0:21123:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9fc1bb53b370) has no exports 00010000:00010000:0.0:1788448681.025877:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448681.025921:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448681.025926:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448681.025935:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448681.025943:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448681.025949:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788448681.025958:0:17134:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788448681.025961:0:17134:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788448681.025975:0:17134:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc184e54000 00010000:00010000:0.0:1788448681.025979:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448681.025985:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448681.026012:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448681.026016:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448681.026022:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448681.026022:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e5600 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448681.026028:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448681.026035:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448681.026042:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448681.026058:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788448681.026060:0:17134:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788448681.026062:0:17134:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788448681.026067:0:17134:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc184e54000 00010000:00010000:0.0:1788448681.026070:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448681.026076:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448681.026093:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448681.026094:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448681.026096:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788448681.027586:0:21123:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc081b56e40 - data ffff9fc1ad820870/ffff9fc0832b8400 00000020:01000000:2.0:1788448681.033054:0:21123:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc083d14840 - data ffff9fc1ada73af8/ffff9fc0836b7800 00100000:10000000:2.0:1788448681.042599:0:21123:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788448681.058722:0:21123:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804a5d 00000020:00000080:2.0:1788448681.058732:0:21123:0:(genops.c:885:class_export_put()) final put ffff9fc1ba066800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788448681.058753:0:21123:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc183e97800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788448681.058756:0:21123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc183e97800 2 00000020:01000004:2.0:1788448681.058759:0:21123:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc183e97800 from lustre-OST0000 00000020:00000080:2.0:1788448681.058782:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448681.058790:0:21123:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788448681.058793:0:21123:0:(genops.c:885:class_export_put()) final put ffff9fc1ba065000/lustre-OST0000_UUID 00000020:00000080:2.0:1788448681.058796:0:21123:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba065000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788448681.058812:0:21123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788448681.058858:0:21123:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788448681.058862:0:21123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788448681.058865:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448681.058870:0:21123:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788448681.058876:0:21123:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fc0835ee800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788448681.058903:0:21123:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9fc1ba058000) has exports, disconnecting them 00000020:00080000:2.0:1788448681.058908:0:21123:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fc0835ee800), last request at 1788448595 00000020:00000080:2.0:1788448681.058911:0:21123:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804a87 00000020:00080000:2.0:1788448681.058920:0:21123:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc0835ee800): rc 0 00000020:00000080:2.0:1788448681.058923:0:21123:0:(genops.c:885:class_export_put()) final put ffff9fc0835ee800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788448681.059719:0:16256:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba066800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788448681.059735:0:16256:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0835ee800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788448681.062010:0:21123:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788448681.062020:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788448681.062024:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788448681.062033:0:21123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788448681.062253:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448681.062262:0:21123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788448681.062269:0:21123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788448681.062275:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448681.062280:0:21123:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788448681.062287:0:21123:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9fc0835ef800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788448681.062293:0:21123:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9fc1ba05cd28) has exports, disconnecting them 00000020:00080000:0.0:1788448681.062298:0:21123:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9fc0835ef800), last request at 1788448595 00000020:00000080:0.0:1788448681.062302:0:21123:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804a9c 00000020:00080000:0.0:1788448681.062319:0:21123:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc0835ef800): rc 0 00000020:00000080:0.0:1788448681.062325:0:21123:0:(genops.c:885:class_export_put()) final put ffff9fc0835ef800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788448681.063053:0:16256:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0835ec000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788448681.063064:0:16256:0:(genops.c:885:class_export_put()) final put ffff9fc1bb4c6800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788448681.063067:0:16256:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bb4c6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788448681.063079:0:16256:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788448681.063147:0:16256:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0835ef800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788448681.063170:0:21123:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788448681.063173:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788448681.063175:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788448681.063180:0:21123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788448681.063196:0:16256:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0835e9000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788448681.063326:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448681.063332:0:21123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788448681.063335:0:21123:0:(genops.c:885:class_export_put()) final put ffff9fc0835ec800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788448681.063338:0:21123:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0835ec800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788448681.063341:0:21123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788448681.063366:0:21123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc183e97800 1 00000020:00000080:1.0:1788448681.063371:0:21123:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804a3a 00000020:00000080:1.0:1788448681.063375:0:21123:0:(genops.c:885:class_export_put()) final put ffff9fc1873a0800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788448681.063383:0:21123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788448681.063390:0:16256:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1873a0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788448681.063398:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448681.063402:0:21123:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788448681.063405:0:21123:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9fc1ba05b370) has no exports 00000020:00000080:0.0:1788448681.210124:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448681.210137:0:21123:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788448681.210143:0:21123:0:(genops.c:885:class_export_put()) final put ffff9fc1873a7800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788448681.210147:0:21123:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1873a7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788448681.210157:0:21123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788448681.210273:0:21123:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc187b77000 00000020:02000400:0.0:1788448681.210321:0:21123:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788448681.726119:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788448682.179981:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448682.180001:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448682.180004:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448682.180007:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788448682.180065:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448682.180081:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826445184:0@lo:400:kworker.0 00000400:00000100:0.0:1788448682.180131:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826445184 offset 0 length 224: 4 00010000:00010000:2.0:1788448682.754084:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448683.074077:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448668/real 1788448668] req@ffff9fc1b6561f80 x1875323826444288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788448683 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448683.074106:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc1b6561f80 x1875323826444288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788448683 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788448683.074127:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187bf5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448683.074163:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448683.074169:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826444288:0@lo:38:kworker.0 00000100:00080000:0.0:1788448683.074319:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448683.074325:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448683.074328:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448683.074331:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788448683.074334:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc187bf5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448683.074339:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 586 00000100:00080000:0.0:1788448683.074348:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788448683.074355:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc187bf5800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448683.074403:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bff0b100 x1875323826445312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448683.074476:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826445440:0@lo:400:kworker.0 00000400:00000100:0.0:1788448683.074523:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826445440 offset 0 length 224: 4 00000100:00100000:1.0:1788448683.074821:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826445312:0@lo:38:kworker.0 00000400:00000100:1.0:1788448683.074869:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826445312 offset 0 length 520: 4 00010000:00010000:0.0:1788448683.778823:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788448684.222427:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448668/real 1788448668] req@ffff9fc1b6560700 x1875323826444416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448684 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448684.273263:0:3647:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9fc1b6560700 x1875323826444416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448684 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788448684.273295:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9fc083f25000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788448684.273300:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788448684.300878:0:3647:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1788448684.301047:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826444416:0@lo:400:kworker.0 00000100:00080000:2.0:1788448684.301138:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788448684.301143:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448684.301146:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788448684.301149:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448684.301151:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788448684.301155:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788448684.301159:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc083f25000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788448684.301164:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 529 00000100:00080000:2.0:1788448684.301174:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9fc083f25000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448684.301214:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1ba34c380 x1875323826445568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448684.301291:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875323826445568:0@lo:38:kworker.0 00000400:00000100:3.0:1788448684.301350:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826445568 offset 0 length 520: 4 00010000:00010000:3.0:1788448684.804459:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448685.823001:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788448686.303805:0:21325:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788448686.314772:0:21325:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788448686.315027:0:21325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.315042:0:21325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.315050:0:21325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.315057:0:21325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448686.319300:0:21325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788448686.319315:0:21325:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788448686.319350:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448686.319362:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bff0b100 x1875323826445312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788448703 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.319385:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788448686.319397:0:21325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788448686.319404:0:21325:0:(import.c:65:import_set_state_nolock()) ffff9fc187bf5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788448686.319409:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448686.319413:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bff0b100 x1875323826445312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788448703 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.319420:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788448686.319423:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:3.0:1788448686.320265:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826445312:0@lo:38:kworker.0 00000100:00080000:1.0:1788448686.321733:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788448686.321748:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bff0a300 x1875323826444672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448687 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321768:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc083e4ca80 x1875323826444800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321782:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1ba34d880 x1875323826445056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448692 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321790:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bff0bb80 x1875323826445184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448698 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321808:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bff09880 x1875323826445440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448699 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321816:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1ba34c380 x1875323826445568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788448694 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321846:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788448686.321852:0:21325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788448686.321857:0:21325:0:(import.c:65:import_set_state_nolock()) ffff9fc083f25000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788448686.321863:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788448686.321867:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bff0a300 x1875323826444672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448687 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321875:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc083e4ca80 x1875323826444800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448689 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321905:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1ba34d880 x1875323826445056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448692 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321912:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bff0bb80 x1875323826445184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448698 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321919:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bff09880 x1875323826445440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448699 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321926:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1ba34c380 x1875323826445568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788448694 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448686.321932:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788448686.321935:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:3.0:1788448686.322227:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826444672:0@lo:400:kworker.0 00000100:00100000:3.0:1788448686.322261:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826445056:0@lo:400:kworker.0 00000100:00100000:3.0:1788448686.322267:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826444800:0@lo:400:kworker.0 00000100:00100000:3.0:1788448686.322294:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875323826445568:0@lo:38:kworker.0 00000100:00100000:2.0:1788448686.322487:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826445440:0@lo:400:kworker.0 00000100:00100000:2.0:1788448686.322508:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826445184:0@lo:400:kworker.0 00010000:00010000:1.0:1788448686.326016:0:21325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448686.326035:0:21325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448686.326043:0:21325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448686.326066:0:21325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.326346:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448686.326353:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.326361:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448686.326365:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.326374:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448686.326382:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448686.326402:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788448686.326405:0:17134:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788448686.326408:0:17134:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788448686.326423:0:17134:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc184e54000 00010000:00010000:0.0:1788448686.326427:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.326433:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.326445:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448686.326447:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.326452:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448686.326455:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.326461:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448686.326468:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448686.326485:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788448686.326487:0:17134:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788448686.326492:0:17134:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc184e54000 00010000:00010000:0.0:1788448686.326494:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.326510:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448686.326511:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448686.326513:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448686.327326:0:21325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788448686.327336:0:21325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448686.327353:0:21325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448686.327361:0:21325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448686.327369:0:21325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448686.327375:0:21325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448686.328660:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448686.328670:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448686.328679:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330c00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448686.328683:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448686.328705:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448686.328712:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448686.328718:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788448686.328721:0:17133:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788448686.328731:0:17133:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc184e54000 00010000:00010000:3.0:1788448686.328734:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448686.328744:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448686.328746:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448686.328748:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448686.328817:0:21325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788448686.328823:0:21325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448686.328839:0:21325:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788448686.328844:0:21325:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788448686.328846:0:21325:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788448686.328902:0:21325:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788448686.328907:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788448686.328913:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1788448686.328916:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788448686.328924:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788448686.328928:0:21325:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9fc191388000) has no exports 00000020:00080000:1.0:1788448686.328950:0:21325:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9fc191388000) has no exports 00000020:01000000:1.0:1788448686.331089:0:21325:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc081b56720 - data ffff9fc192fd6e58/ffff9fc084438c00 00000020:01000000:1.0:1788448686.331345:0:21325:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc081b7f300 - data ffff9fc1adb530d8/ffff9fc1bfe5f400 00100000:10000000:1.0:1788448686.339035:0:21325:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788448686.353259:0:21325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804bbb 00000020:00000080:0.0:1788448686.353273:0:21325:0:(genops.c:885:class_export_put()) final put ffff9fc083f24800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788448686.353298:0:21325:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1bb4c1000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788448686.353302:0:21325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1bb4c1000 2 00000020:01000004:0.0:1788448686.353305:0:21325:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc1bb4c1000 from lustre-OST0001 00000020:00000080:0.0:1788448686.353332:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448686.353343:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788448686.353346:0:21325:0:(genops.c:885:class_export_put()) final put ffff9fc083f24000/lustre-OST0001_UUID 00000020:00000080:0.0:1788448686.353349:0:21325:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083f24000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788448686.353356:0:21325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788448686.353470:0:21325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS 00010000:00010000:0.0:1788448686.353485:0:21325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331a00/0xf45a9e4e6b804906 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b80490d expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448686.353497:0:21325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331a00/0xf45a9e4e6b804906 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b80490d expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448686.353504:0:21325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788448686.353506:0:21325:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788448686.353509:0:21325:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788448686.353523:0:21325:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc184e54000 00010000:00010000:0.0:1788448686.353527:0:21325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331a00/0xf45a9e4e6b804906 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b80490d expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448686.353541:0:21325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448686.353560:0:21325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448686.353565:0:21325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788448686.353568:0:21325:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788448686.353570:0:21325:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788448686.353578:0:21325:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc184e54000 00010000:00010000:0.0:1788448686.353581:0:21325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788448686.353597:0:21325:0:(import.c:65:import_set_state_nolock()) ffff9fc184e54000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788448686.353601:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788448686.353603:0:21325:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788448686.353604:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788448686.353608:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788448686.353618:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1ba34f100 x1875323826444928/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788448691 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788448686.353827:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788448686.353830:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:2.0:1788448686.354354:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083f24800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788448686.356520:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:943bfcb5-816e-4cdd-a66b-4e69884ef502:3644:1875323826444928:0@lo:250:kworker.0 10000000:01000000:0.0:1788448686.360009:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788448686.360026:0:21325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8047e0 00000020:00000080:0.0:1788448686.360035:0:21325:0:(genops.c:885:class_export_put()) final put ffff9fc1ba2db000/943bfcb5-816e-4cdd-a66b-4e69884ef502 00000020:01000000:0.0:1788448686.360057:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.121@tcp (flags='') 00000020:00000080:0.0:1788448686.360067:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448686.360083:0:21325:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.121@tcp: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1788448686.360121:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba2db000/943bfcb5-816e-4cdd-a66b-4e69884ef502 for MGC192.168.206.121@tcp 00000020:00080000:0.0:1788448686.360183:0:21325:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9fc1bb53cd28) has no exports 10000000:01000000:2.0:1788448686.360236:0:17142:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788448686.360346:0:21325:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.121@tcp: client import never connected 00000100:00080000:0.0:1788448686.360350:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788448686.360353:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788448686.360356:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788448686.360392:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788448686.360429:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448686.360435:0:21325:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.121@tcp (uuid 943bfcb5-816e-4cdd-a66b-4e69884ef502) 00000020:01000000:0.0:1788448686.360442:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788448686.360445:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448686.360448:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788448686.360454:0:21325:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fc1b0355800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788448686.360459:0:21325:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9fc19138cd28) has exports, disconnecting them 00000020:00080000:0.0:1788448686.360462:0:21325:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fc1b0355800), last request at 1788448612 00000020:00000080:0.0:1788448686.360466:0:21325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804be5 00000020:00080000:0.0:1788448686.360476:0:21325:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc1b0355800): rc 0 00000020:00000080:0.0:1788448686.360480:0:21325:0:(genops.c:885:class_export_put()) final put ffff9fc1b0355800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788448686.361189:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b0355800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788448686.363000:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc184e54000 for MGC192.168.206.121@tcp 00000020:00000080:2.0:1788448686.363014:0:36:0:(genops.c:885:class_export_put()) final put ffff9fc184e55000/943bfcb5-816e-4cdd-a66b-4e69884ef502 00000020:00000080:2.0:1788448686.363017:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc184e55000/943bfcb5-816e-4cdd-a66b-4e69884ef502 for MGC192.168.206.121@tcp 00000020:01000000:2.0:1788448686.363025:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.121@tcp (943bfcb5-816e-4cdd-a66b-4e69884ef502) 00010000:01000000:2.0:1788448686.380542:0:21325:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788448686.380551:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448686.380555:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788448686.380562:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788448686.380779:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448686.380791:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788448686.380798:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788448686.380807:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448686.380813:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788448686.380821:0:21325:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9fc0831c8000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788448686.380828:0:21325:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9fc1b5d599b8) has exports, disconnecting them 00000020:00080000:2.0:1788448686.380833:0:21325:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9fc0831c8000), last request at 1788448612 00000020:00000080:2.0:1788448686.380838:0:21325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804bfa 00000020:00080000:2.0:1788448686.380856:0:21325:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc0831c8000): rc 0 00000020:00000080:2.0:1788448686.380862:0:21325:0:(genops.c:885:class_export_put()) final put ffff9fc0831c8000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788448686.381563:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc187bf5800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788448686.381574:0:36:0:(genops.c:885:class_export_put()) final put ffff9fc083f21000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788448686.381577:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083f21000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788448686.381589:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788448686.381658:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831c8000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788448686.381685:0:21325:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788448686.381688:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788448686.381691:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788448686.381696:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788448686.381713:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc083f25000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788448686.386418:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788448686.386567:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788448686.389770:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788448686.389996:0:17128:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fc1933aa400:17128] 0 exiting: rc = 1 00000100:00100000:3.0:1788448686.390050:0:17129:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fc082771800:17129] 1 exiting: rc = 0 00000100:00100000:3.0:1788448686.390099:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.390703:0:17131:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fc082770000:17131] 1 exiting: rc = 0 00000100:00100000:2.0:1788448686.390764:0:17132:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fc1b483b000:17132] 2 exiting: rc = 0 00000100:00100000:0.0:1788448686.396313:0:20175:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9fc08220ca00:20175] 4 exiting: rc = 0 00000100:00100000:1.0:1788448686.397081:0:17130:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fc082770600:17130] 0 exiting: rc = 1 00000100:00100000:1.0:1788448686.397169:0:20174:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fc0832c4e00:20174] 3 exiting: rc = 0 00000100:00100000:3.0:1788448686.399076:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399086:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399091:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399097:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399103:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399109:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399114:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399119:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399133:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399139:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399145:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399150:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399155:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399159:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399164:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399169:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399175:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399180:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399185:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399191:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399196:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399201:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399206:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399211:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399216:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399220:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399225:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399230:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399235:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399251:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399256:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399260:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399265:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399269:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399274:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399279:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399285:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399290:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399295:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399301:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399306:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399311:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399316:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399320:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399325:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399330:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399335:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399340:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399345:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399350:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399355:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399360:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399687:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399695:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399699:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399704:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399709:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399715:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399720:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399725:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399730:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399735:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399740:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.399745:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788448686.402092:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448686.402104:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788448686.402109:0:21325:0:(genops.c:885:class_export_put()) final put ffff9fc0831cf800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788448686.402114:0:21325:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831cf800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788448686.402120:0:21325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788448686.403631:0:21325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1bb4c1000 1 00000020:00000080:3.0:1788448686.403641:0:21325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b804b9f 00000020:00000080:3.0:1788448686.403649:0:21325:0:(genops.c:885:class_export_put()) final put ffff9fc187405800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788448686.403667:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788448686.403683:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc187405800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788448686.403696:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448686.403703:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788448686.403706:0:21325:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9fc083f119b8) has no exports 00000020:00000080:3.0:1788448686.571772:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448686.571785:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788448686.571790:0:21325:0:(genops.c:885:class_export_put()) final put ffff9fc083fa0000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788448686.571794:0:21325:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083fa0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788448686.571806:0:21325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788448686.572589:0:21325:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc083fa1800 00000020:01000000:3.0:1788448686.572609:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788448686.572614:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448686.572619:0:21325:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788448686.572624:0:21325:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9fc1ba0599b8) has no exports 00000020:00000080:3.0:1788448686.572649:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448686.572655:0:21325:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788448686.572658:0:21325:0:(genops.c:885:class_export_put()) final put ffff9fc1873a3800/OSS_uuid 00000020:00000080:3.0:1788448686.572660:0:21325:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1873a3800/OSS_uuid for OSS 00000020:01000000:3.0:1788448686.572664:0:21325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1788448686.572726:0:17141:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788448686.572910:0:19177:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9fc083379400:19177] 3 exiting: rc = 0 00000100:00100000:3.0:1788448686.576179:0:19178:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9fc08263e200:19178] 4 exiting: rc = 0 00000100:00100000:3.0:1788448686.576296:0:18650:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9fc1b6665000:18650] 0 exiting: rc = 1 00000100:00100000:3.0:1788448686.576942:0:18651:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9fc1ba214400:18651] 1 exiting: rc = 0 00000100:00100000:3.0:1788448686.583721:0:18652:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9fc1a03ab000:18652] 2 exiting: rc = 0 00000100:00100000:2.0:1788448686.585059:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585069:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585075:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585080:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585085:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585089:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585094:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585099:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585104:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585108:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585114:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585119:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585545:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585553:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585558:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585562:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585567:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585571:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585575:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585579:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585584:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585588:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585594:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585599:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585604:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585609:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585614:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585620:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585629:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585634:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585639:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585644:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585649:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585654:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585668:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585672:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585677:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585682:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585688:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585693:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585698:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585708:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585714:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585718:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585724:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585728:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585733:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585738:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585743:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585747:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585752:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585756:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585761:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585767:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585771:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585776:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585785:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585791:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585796:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585802:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585806:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585811:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585816:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.585820:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.588514:0:18654:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fc1b4833600:18654] 1 exiting: rc = 0 00000100:00100000:0.0:1788448686.588629:0:19888:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9fc081ac2e00:19888] 2 exiting: rc = 0 00000100:00100000:2.0:1788448686.589280:0:18653:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fc1b4833000:18653] 0 exiting: rc = 1 00000100:00100000:0.0:1788448686.589318:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589325:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589330:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589336:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589341:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589346:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589350:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589355:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589359:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589365:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589370:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589376:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589381:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589386:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589454:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589461:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589466:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589481:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589486:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589491:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589497:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589502:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589507:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589512:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589517:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589522:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589527:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589532:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589537:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589542:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589546:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589551:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589555:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589560:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589565:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589569:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589592:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589598:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589603:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589608:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589613:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589618:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589623:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589629:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589634:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589638:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589643:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589647:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589652:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589657:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589662:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589667:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589679:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589684:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589689:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589694:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589698:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589703:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589708:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589713:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589717:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589721:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589725:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.589730:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.591012:0:18655:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fc1b4832800:18655] 0 exiting: rc = 1 00000100:00100000:2.0:1788448686.592251:0:18656:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fc1968a3c00:18656] 1 exiting: rc = 0 00000100:00100000:2.0:1788448686.592551:0:18657:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fc191751400:18657] 2 exiting: rc = 0 00000100:00100000:1.0:1788448686.592746:0:20289:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9fc1bfe49600:20289] 3 exiting: rc = 0 00000100:00100000:3.0:1788448686.592918:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.592925:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.592930:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.592971:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.592978:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.592983:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.592989:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.592995:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593000:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593005:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593011:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593016:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593022:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593027:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593032:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593037:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593042:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593047:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593052:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593058:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593062:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593068:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593084:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593090:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593095:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593100:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593106:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593125:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593131:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593137:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593142:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593146:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593164:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593169:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593174:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593180:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593185:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593191:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593196:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593201:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593206:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593210:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593215:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593220:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593225:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593231:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593237:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593244:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593250:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593256:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593261:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593283:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593290:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593295:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593301:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593308:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593314:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593319:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593326:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593332:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593338:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593344:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593350:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.593365:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.604002:0:18658:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fc191750a00:18658] 0 exiting: rc = 1 00000100:00100000:3.0:1788448686.604392:0:18659:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fc191750e00:18659] 1 exiting: rc = 0 00000100:00100000:2.0:1788448686.604518:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604535:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604541:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604546:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604552:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604562:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604567:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604572:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604582:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604589:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604593:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604598:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604603:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604608:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604613:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604618:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604623:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604629:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604641:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604646:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604652:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604657:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604662:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604666:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604671:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604675:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604681:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604686:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604692:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604697:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604702:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604710:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604716:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604721:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604727:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604731:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604742:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604746:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604751:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604755:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604760:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604766:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604771:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604776:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604780:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604785:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604790:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604798:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604801:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604806:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604811:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604815:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604819:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604824:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604828:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604833:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604847:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604852:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604857:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604862:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604866:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604870:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604875:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448686.604898:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448686.606606:0:18661:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fc1876f3800:18661] 1 exiting: rc = 0 00000100:00100000:2.0:1788448686.606876:0:18660:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fc1bb534800:18660] 0 exiting: rc = 1 00000100:00100000:3.0:1788448686.606951:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.606968:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.606984:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.606990:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607007:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607013:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607018:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607024:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607031:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607037:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607044:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607050:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607083:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607091:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607096:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607103:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607109:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607115:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607120:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607126:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607131:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607137:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607142:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607148:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607168:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607176:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607182:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607189:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607198:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607203:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607209:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607215:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607221:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607227:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607233:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607239:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607262:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607275:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607281:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607287:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607294:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607301:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607306:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607312:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607319:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607324:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607330:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607338:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607359:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607366:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607372:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607378:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607384:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607389:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607395:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607401:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607407:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607412:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607417:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607428:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607434:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607440:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607453:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448686.607467:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788448686.619056:0:21325:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788448707.836452:0:22089:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788448719.180170:0:22689:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788448719.180176:0:22689:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788448719.180177:0:22689:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788448719.180274:0:22689:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc1bfee5000 00000020:01000004:0.0:1788448719.180288:0:22689:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788448719.180295:0:22689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788448719.180307:0:22689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fc1bb538000) 00000020:00000080:0.0:1788448719.180320:0:22689:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788448719.254378:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788448719.256986:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788448719.263067:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788448719.265391:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788448719.265798:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788448719.266479:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788448719.266719:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788448719.270257:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788448719.270829:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788448719.271050:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788448719.271360:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788448719.271601:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788448719.271851:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788448719.272080:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788448719.272390:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788448719.273005:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788448719.273407:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788448719.273737:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788448719.273978:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788448719.274265:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788448719.274613:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788448719.274990:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788448719.275269:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788448719.275632:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788448719.275866:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788448719.276097:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788448719.276407:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788448719.276638:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788448719.277044:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788448719.277362:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788448719.279943:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788448719.280622:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788448719.281373:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788448719.281733:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788448719.282166:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788448719.283394:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788448719.283716:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788448719.283932:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788448719.284126:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788448719.284361:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788448719.284725:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788448719.285944:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788448719.286805:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788448719.287166:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788448719.287575:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788448719.288178:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788448719.290143:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788448719.291251:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788448719.292027:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788448719.292217:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788448719.293356:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788448719.294383:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788448719.295396:0:22689:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1788448719.296134:0:22689:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788448719.296443:0:22689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788448719.296451:0:22689:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788448719.296462:0:22689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b805053 00000020:01000004:1.0:1788448719.296468:0:22689:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788448719.296473:0:22689:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788448719.296478:0:22689:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc1bfee5000 from MGS 00000020:01000004:1.0:1788448719.296493:0:22689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788448719.296502:0:22689:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fc1b5d5cd28) 00000020:00000080:1.0:1788448719.296514:0:22689:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788448719.296569:0:22689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1bfee5000 from MGS, refs=2 00080000:01000000:1.0:1788448719.296573:0:22689:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788448719.296577:0:22689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b805061 00000100:00100000:1.0:1788448719.296978:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788448719.297099:0:22689:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788448719.297104:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788448719.304602:0:22689:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788448719.304613:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788448719.305384:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448719.305621:0:22689:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788448719.305627:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788448719.309620:0:22689:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788448719.309639:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788448719.310400:0:22689:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788448719.310408:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788448719.311381:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448719.311385:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448719.311387:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448719.311753:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448719.311755:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448719.311757:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448719.312997:0:22689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788448719.315803:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788448719.319124:0:22689:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788448719.323451:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788448719.323756:0:22689:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788448719.323818:0:22689:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788448719.325388:0:22689:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788448719.325816:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448719.326001:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788448719.326008:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788448719.329298:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788448719.329309:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788448719.330860:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788448719.330871:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788448719.336626:0:22689:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788448719.336648:0:22689:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.121@tcp' 00000020:01000004:0.0:1788448719.336650:0:22689:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788448719.336679:0:22689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.121@tcp (typ=mgc) 00000020:00000080:0.0:1788448719.336693:0:22689:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.121@tcp (ffff9fc1bb53cd28) 00000020:00000080:0.0:1788448719.336708:0:22689:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788448719.336797:0:22689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc1bfee6800@MGC192.168.206.121@tcp: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448719.336972:0:22689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.121@tcp-0 is initialized 00000040:01000000:0.0:1788448719.336978:0:22689:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788448719.337754:0:22706:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788448719.338347:0:22707:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788448719.338566:0:22689:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.121@tcp (uuid 44e7ff6c-6b3b-4629-bf03-6edc4527824b) 00000020:00000080:2.0:1788448719.338584:0:22689:0:(genops.c:1385:class_connect()) connect: client 44e7ff6c-6b3b-4629-bf03-6edc4527824b, cookie 0xf45a9e4e6b80506f 00000100:00080000:2.0:1788448719.338594:0:22689:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788448719.338601:0:22689:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import ffff9fc1bfee6800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448719.338630:0:22689:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1ba34fb80 x1875323826445696/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448719.338691:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3644:1875323826445696:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788448719.338750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788448719.338854:0:22689:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 44e7ff6c-6b3b-4629-bf03-6edc4527824b->MGS 00000020:01000004:2.0:1788448719.338873:0:22689:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788448719.338878:0:22689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788448719.338903:0:22689:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fc1913899b8) 00000020:00000080:2.0:1788448719.338913:0:22689:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788448719.344600:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826445696 00000100:00100000:1.0:1788448719.344615:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826445696 00000100:00100000:1.0:1788448719.344660:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448719.344668:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1875323826445696:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788448719.344693:0:22703:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 44e7ff6c-6b3b-4629-bf03-6edc4527824b@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:1.0:1788448719.344719:0:22703:0:(genops.c:1385:class_connect()) connect: client 44e7ff6c-6b3b-4629-bf03-6edc4527824b, cookie 0xf45a9e4e6b80507d 00000100:00080000:1.0:1788448719.344863:0:22703:0:(import.c:65:import_set_state_nolock()) ffff9fc183e93800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448719.348610:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+5:3644:x1875323826445696:12345-0@lo:250:mount.lustre.0 Request processed in 3933us (9851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448719.348625:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448719.348723:0:3644:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788448719.348734:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.121@tcp: connect to target with instance 0 00000100:00080000:0.0:1788448719.348742:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788448719.348747:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788448719.348751:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bfee6800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788448719.348753:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788448719.348762:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788448719.348768:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3644:1875323826445696:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788448719.362907:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448719.363112:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788448719.363118:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788448719.364769:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788448719.364779:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788448719.365243:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788448719.365249:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788448719.366105:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448719.366267:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788448719.366273:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788448719.367059:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788448719.367067:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788448719.412070:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448719.412268:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788448719.412275:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788448719.414151:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788448719.414163:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788448719.415034:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448719.415229:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788448719.415235:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788448719.417779:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788448719.417802:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788448719.418800:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448719.419015:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788448719.419021:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788448719.419490:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788448719.419497:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788448719.420340:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448719.420597:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788448719.420603:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788448719.421354:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788448719.421361:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788448719.438634:0:22689:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448719.438831:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788448719.438837:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788448719.440222:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788448719.440233:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788448719.441048:0:22689:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788448719.441056:0:22689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788448719.441870:0:22689:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788448719.442000:0:22689:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788448719.442007:0:22689:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788448719.442104:0:22689:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788448719.442136:0:22689:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.121@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788448719.442140:0:22689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788448719.442142:0:22689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788448719.442143:0:22689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448719.442144:0:22689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448719.442145:0:22689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448719.442147:0:22689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448719.442148:0:22689:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788448719.442149:0:22689:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788448719.442151:0:22689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448719.442152:0:22689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788448719.442155:0:22689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788448719.442156:0:22689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788448719.442162:0:22689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788448719.442163:0:22689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448719.442163:0:22689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448719.442164:0:22689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448719.442165:0:22689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448719.442166:0:22689:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788448719.442167:0:22689:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788448719.442168:0:22689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448719.442168:0:22689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788448719.442190:0:22689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788448719.442207:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826445824:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788448719.442268:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448719.442351:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1916e8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788448719.442393:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826445824 00000100:00100000:2.0:1788448719.442402:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826445824 00000100:00100000:2.0:1788448719.442470:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448719.442479:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+5:22689:x1875323826445824:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788448719.442529:0:22705:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788448719.442532:0:22705:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788448719.442535:0:22705:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788448719.442804:0:22726:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788448719.445174:0:22705:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1788448719.449020:0:22727:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788448719.449030:0:22727:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788448719.449034:0:22727:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788448719.449037:0:22727:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788448719.452026:0:22727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788448719.461029:0:22705:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788448719.461042:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788448719.463190:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+5:22689:x1875323826445824:12345-0@lo:253:mount.lustre.0 Request processed in 20704us (20913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448719.463203:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448719.463305:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826445824:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788448719.463319:0:22689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788448719.463322:0:22689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788448719.463323:0:22689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788448719.463325:0:22689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448719.463326:0:22689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448719.463327:0:22689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448719.463328:0:22689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448719.463330:0:22689:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788448719.463331:0:22689:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788448719.463333:0:22689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448719.463334:0:22689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788448719.463351:0:22689:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc1bfee5000 from lustre-MDT0000 10000000:01000000:1.0:1788448719.463379:0:22689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788448719.463382:0:22689:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788448719.463386:0:22689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fc1bb53cd28 10000000:01000000:1.0:1788448719.463390:0:22689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788448719.463397:0:22689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc1bb53cd28 from 1 10000000:01000000:1.0:1788448719.463400:0:22689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788448719.463432:0:22689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.463458:0:22689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.463467:0:22689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448719.463484:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826445952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788448719.463521:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448719.463558:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1916e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.463648:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826445952 00000100:00100000:0.0:1788448719.463655:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826445952 00000100:00100000:0.0:1788448719.463707:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448719.463716:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+5:22689:x1875323826445952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448719.463727:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448719.463740:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1ee00/0xf45a9e4e6b80508b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805084 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.463760:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1ee00/0xf45a9e4e6b80508b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805084 expref: 6 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.463770:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1ee00/0xf45a9e4e6b80508b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805084 expref: 6 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.463779:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1ee00, rc 0) 00000100:00100000:0.0:1788448719.463835:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+6:22689:x1875323826445952:12345-0@lo:101:mount.lustre.0 Request processed in 120us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.463841:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448719.463924:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826445952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448719.463936:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.463945:0:22689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448719.463991:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826446080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448719.464016:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.464042:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1bb0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448719.464114:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826446080 00000100:00100000:1.0:1788448719.464119:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826446080 00000100:00100000:1.0:1788448719.464140:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448719.464146:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+6:22689:x1875323826446080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448719.464208:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+6:22689:x1875323826446080:12345-0@lo:501:mount.lustre.0 Request processed in 62us (191us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788448719.464214:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448719.464412:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826446080:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788448719.464437:0:22689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788448719.464454:0:22689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.464462:0:22689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448719.464469:0:22689:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc1bfee5000 10000000:01000000:2.0:1788448719.464473:0:22689:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788448719.464484:0:22689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc1bfee5000 10000000:01000000:2.0:1788448719.464487:0:22689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788448719.464489:0:22689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc1bfee5000 from 1 10000000:01000000:2.0:1788448719.464491:0:22689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788448719.464508:0:22689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4e00/0xf45a9e4e6b805092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.464515:0:22689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4e00/0xf45a9e4e6b805092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.464522:0:22689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4e00/0xf45a9e4e6b805092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448719.464533:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826446208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448719.464557:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.464568:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1bb0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.464625:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826446208 00000100:00100000:0.0:1788448719.464629:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826446208 00000100:00100000:0.0:1788448719.464648:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448719.464653:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+6:22689:x1875323826446208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448719.464668:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448719.464678:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b805099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805092 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.464693:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b805099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805092 expref: 7 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.464702:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b805099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805092 expref: 7 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.464708:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e800, rc 0) 00000100:00100000:0.0:1788448719.464746:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+7:22689:x1875323826446208:12345-0@lo:101:mount.lustre.0 Request processed in 92us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.464752:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448719.464831:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826446208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448719.464841:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4e00/0xf45a9e4e6b805092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805099 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.464849:0:22689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4e00/0xf45a9e4e6b805092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805099 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448719.464861:0:22689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788448719.464865:0:22689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4e00/0xf45a9e4e6b805092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805099 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.464872:0:22689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4e00/0xf45a9e4e6b805092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805099 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448719.464913:0:22689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788448719.464916:0:22689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448719.464920:0:22689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc1bfee5000 10000000:01000000:2.0:1788448719.464922:0:22689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788448719.464925:0:22689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788448719.464927:0:22689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788448719.464940:0:22689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b8050a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.464947:0:22689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b8050a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.464955:0:22689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b8050a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448719.464967:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826446336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448719.464991:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.465009:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1bb0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.465116:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826446336 00000100:00100000:0.0:1788448719.465120:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826446336 00000100:00100000:0.0:1788448719.465139:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448719.465145:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+7:22689:x1875323826446336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448719.465151:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448719.465158:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b8050a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8050a0 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.465172:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b8050a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8050a0 expref: 8 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.465180:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b8050a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8050a0 expref: 8 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.465186:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f400, rc 0) 00000100:00100000:0.0:1788448719.465230:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+8:22689:x1875323826446336:12345-0@lo:101:mount.lustre.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.465235:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448719.465353:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826446336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448719.465364:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b8050a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8050a7 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.465372:0:22689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b8050a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8050a7 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448719.465413:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826446464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448719.465439:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.465473:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1bb0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448719.465553:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826446464 00000100:00100000:1.0:1788448719.465558:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826446464 00000100:00100000:1.0:1788448719.465578:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448719.465584:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+8:22689:x1875323826446464:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448719.465692:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+9:22689:x1875323826446464:12345-0@lo:501:mount.lustre.0 Request processed in 107us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448719.465699:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788448719.465770:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826446464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448719.465810:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826446592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448719.465849:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.465872:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1bb0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.466025:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826446592 00000100:00100000:0.0:1788448719.466029:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826446592 00000100:00100000:0.0:1788448719.466047:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448719.466053:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+9:22689:x1875323826446592:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448719.467024:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+9:22689:x1875323826446592:12345-0@lo:503:mount.lustre.0 Request processed in 968us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448719.467034:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788448719.472013:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826446592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448719.473468:0:22728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22728:1875323826446720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448719.473531:0:22728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448719.473611:0:22728:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1921253c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448719.473855:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826446720 00000100:00100000:1.0:1788448719.473862:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826446720 00000100:00100000:1.0:1788448719.474121:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448719.474131:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+9:22728:x1875323826446720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448719.474939:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+9:22728:x1875323826446720:12345-0@lo:502:llog_process_th.0 Request processed in 808us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448719.474949:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448719.475170:0:22728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22728:1875323826446720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448719.475200:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448719.475210:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448719.475213:0:22728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788448719.475217:0:22728:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788448719.475220:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788448719.475232:0:22728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fc1bb53b370) 00000020:00000080:0.0:1788448719.475247:0:22728:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788448719.475251:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788448719.475318:0:22728:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788448719.475323:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b8050b5 00000020:00000080:0.0:1788448719.475598:0:22728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788448719.475602:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448719.475606:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448719.475607:0:22728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788448719.475610:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448719.475613:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448719.475614:0:22728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788448719.475617:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788448719.475630:0:22728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fc1bb5399b8) 00000020:00000080:0.0:1788448719.475639:0:22728:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788448719.475643:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788448719.475645:0:22728:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788448719.475647:0:22728:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788448719.475653:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788448719.475697:0:22728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1bfee5000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788448719.475710:0:22728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fc19ebe99b8) 00000020:00000080:0.0:1788448719.475717:0:22728:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788448719.475774:0:22728:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788448719.475779:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b8050ca 00000020:00000080:0.0:1788448719.475875:0:22728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788448719.476501:0:22728:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788448719.476509:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf45a9e4e6b8050d1 00080000:01000000:0.0:1788448719.476515:0:22728:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788448719.476519:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b8050d8 00010000:00010000:2.0:1788448719.604841:0:22728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788448719.607941:0:22728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934629 00000001:00080000:2.0:1788448719.609619:0:22728:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788448719.612294:0:22728:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fc19138cd28) 00000020:00000080:2.0:1788448719.612317:0:22728:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788448719.612425:0:22728:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788448719.612433:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b8050e6 00000020:00000080:2.0:1788448719.613136:0:22728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788448719.617017:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf45a9e4e6b8050ed 00000020:00000080:3.0:1788448719.619737:0:22728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788448719.619750:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448719.619756:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.619758:0:22728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788448719.619771:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788448719.619774:0:22728:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788448719.619776:0:22728:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448719.619778:0:22728:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448719.619788:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788448719.619791:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.619792:0:22728:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788448719.619795:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448719.619800:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.619801:0:22728:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788448719.619805:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788448719.619854:0:22728:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788448719.619873:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448719.619876:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.619878:0:22728:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788448719.619912:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448719.619916:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.619918:0:22728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788448719.619921:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788448719.619925:0:22728:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:00000080:3.0:1788448719.619952:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448719.619967:0:22728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9fc083f119b8) 00000020:00000080:3.0:1788448719.619982:0:22728:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788448719.619986:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788448719.620039:0:22728:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788448719.620045:0:22728:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788448719.620057:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b8050fb 00010000:00080000:3.0:1788448719.620086:0:22728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc1852d4800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:3.0:1788448719.621690:0:22728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788448719.632177:0:22728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788448719.632191:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788448719.632240:0:22728:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788448719.632259:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b805102 00000100:00080000:3.0:1788448719.632270:0:22728:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788448719.632275:0:22728:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc1852d4800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448719.632309:0:22728:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1b6560700 x1875323826446848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448719.632392:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826446848:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788448719.632451:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.632554:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826446848 00000100:00100000:2.0:1788448719.632562:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826446848 00000100:00100000:2.0:1788448719.632596:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448719.632604:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826446848:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788448719.632618:0:22715:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788448719.633293:0:22728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788448719.633376:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448719.633381:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.633383:0:22728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788448719.633387:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788448719.633389:0:22728:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788448719.633391:0:22728:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448719.633392:0:22728:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448719.633394:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788448719.633396:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.633397:0:22728:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788448719.633399:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788448719.633404:0:22728:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788448719.633407:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.633408:0:22728:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788448719.633411:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788448719.633415:0:22728:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:3.0:1788448719.633436:0:22728:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788448719.633438:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448719.633451:0:22728:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fc083f14d28) 00000020:00000080:3.0:1788448719.633471:0:22728:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788448719.633477:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788448719.633583:0:22728:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788448719.633589:0:22728:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788448719.633594:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b805110 00010000:00080000:3.0:1788448719.633619:0:22728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc083f69800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:3.0:1788448719.633974:0:22728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788448719.637351:0:22728:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788448719.637795:0:22728:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788448719.649022:0:22728:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448719.649599:0:22728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788448719.660369:0:22728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1788448719.660962:0:22734:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788448719.660967:0:22734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788448719.661990:0:22728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788448719.662003:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788448719.662039:0:22728:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788448719.662057:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b805117 00000100:00080000:3.0:1788448719.662068:0:22728:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788448719.662073:0:22728:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc083f69800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448719.662105:0:22728:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1b6560e00 x1875323826446976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448719.662163:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826446976:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788448719.662212:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826446976 offset 0 length 520: 4 00000100:00080000:3.0:1788448719.662266:0:22728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788448719.662347:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448719.662352:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.662354:0:22728:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788448719.662357:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788448719.662359:0:22728:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788448719.662361:0:22728:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448719.662363:0:22728:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448719.662365:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788448719.662367:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.662369:0:22728:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788448719.662380:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788448719.662385:0:22728:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788448719.662390:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.662391:0:22728:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788448719.662394:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788448719.662397:0:22728:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:3.0:1788448719.662420:0:22728:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788448719.662422:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448719.662436:0:22728:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fc083f10000) 00000020:00000080:3.0:1788448719.662447:0:22728:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788448719.662452:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788448719.662544:0:22728:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788448719.662551:0:22728:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788448719.662558:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b805125 00010000:00080000:3.0:1788448719.662588:0:22728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc182d6f000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:3.0:1788448719.662839:0:22728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788448719.662930:0:22728:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788448719.662944:0:22728:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:1.0:1788448719.666480:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788448719.666486:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788448719.666829:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826446848:12345-0@lo:38:llog_process_th.0 Request processed in 34220us (34373us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788448719.666846:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448719.666936:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448719.666949:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3646:1875323826447104:0@lo:400:kworker.0 00000100:00100000:1.0:1788448719.666985:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448719.670919:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826447104 00000100:00100000:3.0:1788448719.670929:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826447104 00000100:00100000:3.0:1788448719.670969:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788448719.670978:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+9:3646:x1875323826447104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448719.671065:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+9:3646:x1875323826447104:12345-0@lo:400:kworker.0 Request processed in 88us (4078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448719.671071:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448719.671133:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3646:1875323826447104:0@lo:400:kworker.0 00000040:00080000:1.0:1788448719.671438:0:22728:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788448719.671984:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1852d4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448719.671992:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788448719.671995:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826446848:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788448719.672935:0:22728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788448719.673188:0:22728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788448719.673807:0:22736:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788448719.673813:0:22736:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788448719.676853:0:22728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788448719.676869:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788448719.676931:0:22728:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788448719.676961:0:22728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b80512c 00000100:00080000:2.0:1788448719.676971:0:22728:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788448719.676976:0:22728:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc182d6f000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448719.677014:0:22728:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1ba34f800 x1875323826447232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788448719.677036:0:22728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788448719.677098:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448719.677102:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448719.677104:0:22728:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788448719.677107:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448719.677111:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448719.677112:0:22728:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788448719.677115:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788448719.677116:0:22728:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788448719.677119:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448719.677122:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448719.677123:0:22728:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788448719.677125:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448719.677128:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448719.677129:0:22728:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788448719.677133:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788448719.677163:0:22728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22728:1875323826447360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448719.677235:0:22728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.677267:0:22728:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292000 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.677341:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826447232:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788448719.677370:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826447232 offset 0 length 520: 4 00000100:00080000:1.0:1788448719.677556:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788448719.677560:0:16256:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788448719.677563:0:16256:0:(import.c:65:import_set_state_nolock()) ffff9fc1852d4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448719.677573:0:16256:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 636 00000100:00080000:1.0:1788448719.677577:0:16256:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788448719.677580:0:16256:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc1852d4800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448719.677594:0:16256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083e4d500 x1875323826447488/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448719.677630:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826447360 00000100:00100000:1.0:1788448719.677635:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826447360 00000100:00100000:1.0:1788448719.677685:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788448719.677693:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+9:22728:x1875323826447360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448719.677812:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+9:22728:x1875323826447360:12345-0@lo:502:llog_process_th.0 Request processed in 118us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448719.677820:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448719.677904:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826447488:0@lo:38:kworker.0 00000100:00100000:0.0:1788448719.677929:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448719.678187:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826447488 00000100:00100000:1.0:1788448719.678192:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826447488 00000100:00100000:1.0:1788448719.678217:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448719.678222:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826447488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788448719.678234:0:22716:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788448719.678263:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826447488:12345-0@lo:38:kworker.0 Request processed in 41us (333us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788448719.678269:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788448719.678335:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1852d4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448719.678339:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788448719.678342:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826447488:0@lo:38:kworker.0 00000100:00100000:2.0:1788448719.678429:0:22728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22728:1875323826447360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788448719.678451:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448719.678456:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448719.678458:0:22728:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788448719.678462:0:22728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788448719.678694:0:22689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788448719.678713:0:22689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788448719.678732:0:22689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b8050a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8050a7 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.678742:0:22689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b8050a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8050a7 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448719.678757:0:22689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc1bfee5000 from 1 10000000:01000000:1.0:1788448719.678760:0:22689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788448719.678793:0:22689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.678800:0:22689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.678809:0:22689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448719.678823:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826447616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788448719.678854:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448719.678911:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448719.679065:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826447616 00000100:00100000:2.0:1788448719.679076:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826447616 00000100:00100000:2.0:1788448719.679108:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448719.679115:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+9:22689:x1875323826447616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448719.679124:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448719.679137:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1871e5000/0xf45a9e4e6b80513a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805133 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.679156:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1871e5000/0xf45a9e4e6b80513a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805133 expref: 10 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.679166:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1871e5000/0xf45a9e4e6b80513a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805133 expref: 10 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.679175:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e5000, rc 0) 00000100:00100000:2.0:1788448719.679204:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+10:22689:x1875323826447616:12345-0@lo:101:mount.lustre.0 Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448719.679210:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448719.679269:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826447616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448719.679286:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.679293:0:22689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448719.679866:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826447744:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788448719.679936:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448719.679961:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc199bf6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788448719.680344:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826447744 00000100:00100000:2.0:1788448719.680349:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826447744 00000100:00100000:2.0:1788448719.680387:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448719.680395:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+10:22689:x1875323826447744:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788448719.680421:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788448719.680427:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788448719.680495:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+10:22689:x1875323826447744:12345-0@lo:256:mount.lustre.0 Request processed in 100us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448719.680502:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448719.680844:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826447744:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788448719.681521:0:22689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788448719.681541:0:22689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448719.681597:0:22689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448719.681605:0:22689:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1bfee5000 from 1 10000000:01000000:3.0:1788448719.681607:0:22689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448719.681637:0:22689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448719.681644:0:22689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448719.681769:0:22689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448719.681799:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826447872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788448719.681839:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448719.681875:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b76f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.681965:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826447872 00000100:00100000:0.0:1788448719.681970:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826447872 00000100:00100000:0.0:1788448719.682008:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788448719.682015:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+10:22689:x1875323826447872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448719.682024:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448719.682037:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1e000/0xf45a9e4e6b805148 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805141 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.682055:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1e000/0xf45a9e4e6b805148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805141 expref: 11 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.682063:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1e000/0xf45a9e4e6b805148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805141 expref: 11 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.682071:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e000, rc 0) 00000100:00100000:0.0:1788448719.682099:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:22689:x1875323826447872:12345-0@lo:101:mount.lustre.0 Request processed in 85us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.682105:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448719.682217:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826447872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448719.682229:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448719.682237:0:22689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448719.682296:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826448000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448719.682318:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448719.682341:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b76f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.682663:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826448000 00000100:00100000:0.0:1788448719.682673:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826448000 00000100:00100000:0.0:1788448719.682700:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788448719.682706:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:22689:x1875323826448000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448719.682827:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:22689:x1875323826448000:12345-0@lo:501:mount.lustre.0 Request processed in 121us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.682834:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448719.683100:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826448000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448719.683130:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826448128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448719.683166:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448719.683195:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b76f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448719.683249:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826448128 00000100:00100000:1.0:1788448719.683253:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826448128 00000100:00100000:1.0:1788448719.683286:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448719.683293:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:22689:x1875323826448128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448719.683379:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:22689:x1875323826448128:12345-0@lo:503:mount.lustre.0 Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448719.683386:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788448719.683535:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826448128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448719.684017:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22738:1875323826448256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448719.684052:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448719.684081:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b76300 going to sleep for 11 seconds 00000100:00100000:1.0:1788448719.684130:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826448256 00000100:00100000:1.0:1788448719.684134:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826448256 00000100:00100000:1.0:1788448719.684163:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448719.684171:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:22738:x1875323826448256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448719.685241:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:22738:x1875323826448256:12345-0@lo:502:llog_process_th.0 Request processed in 1065us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448719.685262:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788448719.685335:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22738:1875323826448256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448719.685364:0:22738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448719.685372:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.685374:0:22738:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788448719.685380:0:22738:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc1bfee5000 00000020:00000080:3.0:1788448719.685383:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448719.685390:0:22738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448719.685393:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.685394:0:22738:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788448719.685396:0:22738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448719.685398:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.685400:0:22738:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788448719.685403:0:22738:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc1bfee5000 00000020:00000080:3.0:1788448719.685405:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448719.685472:0:22738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448719.685475:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.685477:0:22738:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788448719.685479:0:22738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448719.685482:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.685483:0:22738:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788448719.685486:0:22738:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc1bfee5000 00000020:00000080:3.0:1788448719.685494:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448719.685525:0:22738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448719.685529:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.685530:0:22738:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788448719.685532:0:22738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448719.685535:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448719.685536:0:22738:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788448719.685540:0:22738:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc1bfee5000 00000020:00000080:3.0:1788448719.685542:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788448719.685580:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22738:1875323826448384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448719.685622:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448719.685671:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b76300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.685994:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826448384 00000100:00100000:0.0:1788448719.686002:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826448384 00000100:00100000:0.0:1788448719.686045:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788448719.686054:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:22738:x1875323826448384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448719.686167:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:22738:x1875323826448384:12345-0@lo:502:llog_process_th.0 Request processed in 113us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.686174:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448719.686245:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22738:1875323826448384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788448719.686268:0:22738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448719.686273:0:22738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448719.686275:0:22738:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788448719.686278:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788448719.688134:0:22689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788448719.688164:0:22689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448719.688185:0:22689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.688196:0:22689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448719.688250:0:22689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788448719.688253:0:22689:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc1bfee5000 10000000:01000000:0.0:1788448719.688256:0:22689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc1bfee5000 10000000:01000000:0.0:1788448719.688259:0:22689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788448719.688265:0:22689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc1bfee5000 from 1 10000000:01000000:0.0:1788448719.688267:0:22689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788448719.688297:0:22689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fc00/0xf45a9e4e6b80514f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.688310:0:22689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fc00/0xf45a9e4e6b80514f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.688321:0:22689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fc00/0xf45a9e4e6b80514f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448719.688340:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826448512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788448719.688395:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448719.688444:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08272a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448719.692910:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826448512 00000100:00100000:2.0:1788448719.692923:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826448512 00000100:00100000:2.0:1788448719.692969:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788448719.692985:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:22689:x1875323826448512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448719.693000:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448719.693016:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1871e5e00/0xf45a9e4e6b805156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80514f expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.693043:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1871e5e00/0xf45a9e4e6b805156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80514f expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.693055:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1871e5e00/0xf45a9e4e6b805156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80514f expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.693064:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e5e00, rc 0) 00000100:00100000:2.0:1788448719.693129:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22689:x1875323826448512:12345-0@lo:101:mount.lustre.0 Request processed in 146us (4733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448719.693136:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448719.695208:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826448512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448719.695235:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fc00/0xf45a9e4e6b80514f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805156 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.695246:0:22689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fc00/0xf45a9e4e6b80514f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805156 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448719.695323:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826448640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448719.695373:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448719.695415:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08272a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.695528:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826448640 00000100:00100000:0.0:1788448719.695534:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826448640 00000100:00100000:0.0:1788448719.695579:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448719.695588:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22689:x1875323826448640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448719.695899:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22689:x1875323826448640:12345-0@lo:501:mount.lustre.0 Request processed in 293us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.695906:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788448719.696010:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826448640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448719.696040:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826448768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448719.696079:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.696097:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.698667:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826448768 00000100:00100000:0.0:1788448719.698679:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826448768 00000100:00100000:0.0:1788448719.698737:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448719.698746:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22689:x1875323826448768:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448719.708166:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22689:x1875323826448768:12345-0@lo:503:mount.lustre.0 Request processed in 9409us (12075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.708181:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788448719.708209:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826448768:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448719.709731:0:22743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22743:1875323826448896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448719.709809:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448719.709846:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826448896 00000100:00100000:0.0:1788448719.709852:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826448896 00000100:00100000:0.0:1788448719.709921:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448719.709930:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22743:x1875323826448896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448719.710027:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22743:x1875323826448896:12345-0@lo:502:llog_process_th.0 Request processed in 99us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.710034:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448719.710090:0:22743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08272aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.710107:0:22743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22743:1875323826448896:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788448719.710156:0:22743:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788448719.710171:0:22743:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fc19ebeb370) 00000020:00000080:0.0:1788448719.710191:0:22743:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788448719.710263:0:22743:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1bfee5000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788448719.710267:0:22743:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1bfee5000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788448719.710269:0:22743:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1bfee5000 4 00010000:00080000:0.0:1788448719.710297:0:22743:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc0835ab800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448719.712080:0:22743:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788448719.715119:0:22743:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788448719.715165:0:22743:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788448719.715180:0:22743:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf45a9e4e6b805164 00000100:00080000:2.0:1788448719.715190:0:22743:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788448719.715197:0:22743:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fc0835ab800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448719.715229:0:22743:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1ba34e300 x1875323826449024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788448719.715266:0:22743:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788448719.716984:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826449024:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788448719.717059:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.720071:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826449024 00000100:00100000:2.0:1788448719.720083:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826449024 00000100:00100000:2.0:1788448719.720122:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448719.720130:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826449024:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448719.720223:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826449024:12345-0@lo:38:llog_process_th.0 Request processed in 92us (3163us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788448719.720232:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448719.720401:0:22743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22743:1875323826449152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448719.720964:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.721011:0:22743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.721012:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826449152 00000100:00100000:0.0:1788448719.721027:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826449152 00000100:00100000:0.0:1788448719.721079:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788448719.721088:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22743:x1875323826449152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448719.721208:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22743:x1875323826449152:12345-0@lo:502:llog_process_th.0 Request processed in 120us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.721218:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448719.721743:0:22743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22743:1875323826449152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448719.721801:0:22743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22743:1875323826449280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448719.721850:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.721874:0:22743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.722259:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826449280 00000100:00100000:0.0:1788448719.722266:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826449280 00000100:00100000:0.0:1788448719.722301:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788448719.722311:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22743:x1875323826449280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448719.722411:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22743:x1875323826449280:12345-0@lo:502:llog_process_th.0 Request processed in 102us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.722417:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788448719.722457:0:22743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22743:1875323826449280:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788448719.722475:0:22743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788448719.722592:0:22689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788448719.722610:0:22689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788448719.722631:0:22689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fc00/0xf45a9e4e6b80514f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805156 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.722640:0:22689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fc00/0xf45a9e4e6b80514f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805156 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788448719.722830:0:22689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788448719.722832:0:22689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788448719.722834:0:22689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448719.722835:0:22689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448719.722836:0:22689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448719.722842:0:22689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448719.722843:0:22689:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448719.722844:0:22689:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788448719.722845:0:22689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448719.722846:0:22689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788448719.722850:0:22689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788448719.722852:0:22689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788448719.722853:0:22689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788448719.722854:0:22689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448719.722855:0:22689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448719.722856:0:22689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448719.722857:0:22689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448719.722858:0:22689:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448719.722858:0:22689:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788448719.722859:0:22689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448719.722860:0:22689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788448719.722874:0:22689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788448719.722900:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826449408:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788448719.722932:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448719.722956:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08272a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.722973:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826449408 00000100:00100000:0.0:1788448719.722977:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826449408 00000100:00100000:0.0:1788448719.722999:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788448719.723005:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22689:x1875323826449408:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788448719.723024:0:22704:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788448719.723037:0:22704:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788448719.723967:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788448719.723977:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ab800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448719.723981:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788448719.723985:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826449024:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788448719.725628:0:22704:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788448719.725641:0:22704:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788448719.726847:0:22726:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788448719.726861:0:22726:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788448719.726899:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.726917:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1871e5000/0xf45a9e4e6b80513a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805133 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.726926:0:22726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.726964:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1871e5000/0xf45a9e4e6b80513a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b805133 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.726979:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc1871e5000/0xf45a9e4e6b80513a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b805133 expref: 12 pid: 22704 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448719.726993:0:22726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826449536:0@lo:104: 00000100:00100000:0.0:1788448719.727049:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448719.727087:0:22726:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08272acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448719.727124:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826449536 00000100:00100000:0.0:1788448719.727131:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826449536 00000100:00100000:0.0:1788448719.727174:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448719.727182:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:22726:x1875323826449536:12345-0@lo:104: 00010000:00010000:0.0:1788448719.727193:0:22693:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448719.727239:0:22693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448719.727245:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:22726:x1875323826449536:12345-0@lo:104: Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448719.727252:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448719.727291:0:22726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826449536:0@lo:104: 00010000:00010000:0.0:1788448719.727308:0:22726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.728176:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448719.728185:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.728194:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fdc00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448719.728198:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.728206:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448719.728212:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448719.728218:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448719.728252:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.728259:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448719.728278:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.728291:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80513a expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.728305:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448719.728307:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448719.728309:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448719.728331:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3646:1875323826449664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448719.728371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448719.729284:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22689:x1875323826449408:12345-0@lo:253:mount.lustre.0 Request processed in 6274us (6347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448719.729295:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788448719.729383:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826449664 00000100:00100000:1.0:1788448719.729389:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826449664 00000100:00100000:0.0:1788448719.729515:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22689:1875323826449408:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788448719.729527:0:22689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788448719.729530:0:22689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788448719.729532:0:22689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788448719.729533:0:22689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448719.729535:0:22689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448719.729536:0:22689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448719.729538:0:22689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448719.729539:0:22689:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448719.729541:0:22689:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788448719.729542:0:22689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448719.729543:0:22689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788448719.729558:0:22689:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788448719.729694:0:22695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1871e5000/0xf45a9e4e6b80513a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805133 expref: 12 pid: 22704 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448719.729728:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448719.729738:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:3646:x1875323826449664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448719.729751:0:22695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448719.729757:0:22695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1871e5000/0xf45a9e4e6b80513a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805133 expref: 12 pid: 22704 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.729767:0:22695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1871e5000/0xf45a9e4e6b80513a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b805133 expref: 12 pid: 22704 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.729792:0:22695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1871e5000/0xf45a9e4e6b80513a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b805133 expref: 12 pid: 22704 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.729808:0:22695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.729828:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788448719.730548:0:22695:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003688352s 00010000:00010000:1.0:1788448719.730554:0:22695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.730561:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.730568:0:22695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.730574:0:22695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.730581:0:22695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ea00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448719.730585:0:22695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.730592:0:22695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.730616:0:22695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448719.730627:0:22695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448719.730677:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:3646:x1875323826449664:12345-0@lo:103:ldlm_bl.0 Request processed in 941us (2305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448719.730685:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448719.730732:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3646:1875323826449664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448719.731726:0:22726:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.731738:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448719.731745:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b80516b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788448719.754770:0:22689:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1788448719.755175:0:22689:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788448719.758060:0:22750:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1788448719.758069:0:22750:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1788448719.758841:0:22751:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788448719.758971:0:22689:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788448719.759405:0:22751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788448719.759543:0:22752:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9fc1ba34df80 x1875323826449792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448719.759555:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000040:01000000:3.0:1788448719.759976:0:22689:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788448719.760013:0:22689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788448719.760999:0:22689:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788448719.761012:0:22689:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788448719.761063:0:22689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448719.762297:0:22689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788448719.764792:0:22689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788448719.764944:0:22689:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788448719.767107:0:22689:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788448719.769426:0:22689:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000040:00080000:0.0:1788448719.769935:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788448719.770004:0:22751:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:2.0:1788448719.774576:0:22689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788448719.776996:0:22689:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788448719.777031:0:22689:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbf8c014bb988 00100000:10000000:2.0:1788448719.777038:0:22689:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788448719.777774:0:22689:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788448719.777803:0:22689:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788448719.777823:0:22689:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788448719.777838:0:22689:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788448719.783290:0:22689:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448719.783609:0:22689:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788448720.320818:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788448720.382000:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788448720.382009:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc1bfee5000 from 11 10000000:01000000:1.0:1788448720.382014:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788448720.382071:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448720.382082:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448720.382093:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448720.382118:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826449920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448720.382182:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448720.382227:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448720.382337:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826449920 00000100:00100000:0.0:1788448720.382346:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826449920 00000100:00100000:0.0:1788448720.382661:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788448720.382674:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+11:22707:x1875323826449920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448720.382688:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448720.382714:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805172 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448720.382738:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805172 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448720.382749:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805172 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448720.382758:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1ea00, rc 0) 00000100:00100000:0.0:1788448720.384116:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22707:x1875323826449920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1439us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448720.384128:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788448720.386863:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826449920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448720.387021:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448720.387034:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448720.387376:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826450048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788448720.387621:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448720.387679:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448720.387734:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826450048 00000100:00100000:2.0:1788448720.387743:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826450048 00000100:00100000:2.0:1788448720.387804:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788448720.387816:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22707:x1875323826450048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788448720.387836:0:22704:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788448720.387852:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788448720.387855:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788448720.388110:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:22707:x1875323826450048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 296us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448720.388119:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448720.388254:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826450048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788448720.388308:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788448720.388316:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448720.388326:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448720.766062:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000040:00080000:2.0:1788448720.773296:0:22746:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788448720.773307:0:22746:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448720.774936:0:22746:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788448720.774947:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788448721.342062:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448721.791158:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000040:00080000:3.0:1788448721.792729:0:22746:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788448721.792738:0:22746:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448721.792875:0:22746:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1788448721.792932:0:22746:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448721.793077:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1788448722.371293:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448722.816923:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00010000:00010000:3.0:1788448723.390131:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448723.838955:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000001:02000400:0.0:1788448723.996715:0:22994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788448724.414443:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448724.861950:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000020:00000004:3.0:1788448724.940207:0:23047:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788448724.940375:0:23047:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788448725.183061:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1788448725.183523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788448725.183529:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788448725.183533:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc1852d4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448725.183541:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 637 00000100:00080000:1.0:1788448725.183547:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788448725.183553:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc1852d4800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448725.183578:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083e4ed80 x1875323826450304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448725.183605:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448725.183609:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448725.183613:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448725.183616:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448725.183619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788448725.183631:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788448725.183633:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ab800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448725.183639:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fc0835ab800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448725.183654:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083e4fb80 x1875323826450432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448725.184272:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826450304:0@lo:38:kworker.0 00000100:00100000:0.0:1788448725.184332:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448725.184380:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826450432:0@lo:38:kworker.0 00000100:00100000:0.0:1788448725.184400:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448725.184633:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826450304 00000100:00100000:1.0:1788448725.184640:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826450304 00000100:00100000:1.0:1788448725.184673:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448725.184679:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826450304:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788448725.184695:0:22716:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788448725.184732:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826450304:12345-0@lo:38:kworker.0 Request processed in 52us (400us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788448725.184738:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448725.184813:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826450176:0@lo:400:kworker.0 00000100:00100000:2.0:1788448725.184852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448725.184988:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826450176 00000100:00100000:1.0:1788448725.184993:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826450176 00000100:00100000:1.0:1788448725.185026:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448725.185031:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826450432 00000100:00100000:1.0:1788448725.185033:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:3648:x1875323826450176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448725.185035:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826450432 00000100:00100000:2.0:1788448725.185053:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448725.185058:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826450432:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788448725.185071:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:3648:x1875323826450176:12345-0@lo:400:kworker.0 Request processed in 39us (220us total) trans 0 rc 0/0 00010000:00080000:2.0:1788448725.185074:0:22712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000100:00100000:1.0:1788448725.185077:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:2.0:1788448725.185106:0:22712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf45a9e4e6b805180 00000004:00100000:2.0:1788448725.185121:0:22712:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788448725.185257:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9fc199801800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448725.185304:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875323826450432:12345-0@lo:38:kworker.0 Request processed in 243us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448725.185311:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448725.185366:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826450176:0@lo:400:kworker.0 00000100:00080000:0.0:1788448725.185385:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1852d4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448725.185391:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788448725.185394:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826450304:0@lo:38:kworker.0 00010000:00080000:0.0:1788448725.185407:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc083e4fb80 x1875323826450432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788448725.185419:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788448725.185426:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788448725.185430:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788448725.185438:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ab800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788448725.185443:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826450432:0@lo:38:kworker.0 00010000:00010000:3.0:1788448725.443250:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448725.886082:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000020:00000004:1.0:1788448725.906393:0:23097:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788448725.909850:0:23097:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788448726.463071:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448726.913971:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00010000:00010000:3.0:1788448727.486960:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448727.934354:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00010000:00010000:3.0:1788448728.511161:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448728.960196:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000100:00100000:0.0:1788448729.280127:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448719/real 1788448719] req@ffff9fc1ba34f800 x1875323826447232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448729 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448729.280157:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc1ba34f800 x1875323826447232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448729 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448729.280168:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448719/real 1788448719] req@ffff9fc1b6560e00 x1875323826446976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448729 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448729.280180:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc1b6560e00 x1875323826446976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448729 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788448729.280196:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc182d6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448729.280252:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788448729.280257:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826447232:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788448729.280263:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc083f69800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788448729.280357:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826450560:0@lo:400:kworker.0 00000100:00100000:3.0:1788448729.280415:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788448729.280476:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788448729.280481:0:16256:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788448729.280484:0:16256:0:(import.c:65:import_set_state_nolock()) ffff9fc1852d4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448729.280489:0:16256:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:1.0:1788448729.280517:0:16256:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788448729.280524:0:16256:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc1852d4800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448729.280544:0:16256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083e4ce00 x1875323826450688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448729.280553:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448729.280556:0:16256:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788448729.280557:0:16256:0:(import.c:65:import_set_state_nolock()) ffff9fc083f69800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448729.280560:0:16256:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 637 00000100:00080000:1.0:1788448729.280562:0:16256:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788448729.280564:0:16256:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc083f69800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448729.280574:0:16256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083e4c380 x1875323826450816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448729.280582:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448729.280585:0:16256:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788448729.280586:0:16256:0:(import.c:65:import_set_state_nolock()) ffff9fc182d6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448729.280589:0:16256:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 637 00000100:00080000:1.0:1788448729.280591:0:16256:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788448729.280594:0:16256:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc182d6f000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448729.280605:0:16256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083e4fb80 x1875323826450944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448729.280640:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826451072:0@lo:400:kworker.0 00000100:00100000:1.0:1788448729.280671:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448729.280720:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826451072 00000100:00100000:1.0:1788448729.280738:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826451072 00000100:00100000:1.0:1788448729.280788:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448729.280804:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826451072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448729.280852:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826451072:12345-0@lo:400:kworker.0 Request processed in 50us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448729.280859:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788448729.280907:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc083e4ed80 x1875323826451072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448729.280919:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826451072:0@lo:400:kworker.0 00000100:00080000:0.0:1788448729.281087:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788448729.281103:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826446976:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788448729.281127:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826450688:0@lo:38:kworker.0 00000100:00100000:0.0:1788448729.281160:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448729.281182:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826450816:0@lo:8:kworker.0 00000400:00000100:0.0:1788448729.281202:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826450816 offset 0 length 520: 4 00000100:00100000:0.0:1788448729.281230:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826450944:0@lo:8:kworker.0 00000400:00000100:0.0:1788448729.281246:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826450944 offset 0 length 520: 4 00000100:00100000:0.0:1788448729.281277:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826450688 00000100:00100000:0.0:1788448729.281281:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826450688 00000100:00100000:0.0:1788448729.281304:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448729.281308:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826450688:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788448729.281323:0:22716:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788448729.281353:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826450688:12345-0@lo:38:kworker.0 Request processed in 44us (193us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788448729.281358:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788448729.281386:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1852d4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448729.281389:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788448729.281392:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826450688:0@lo:38:kworker.0 00000100:00100000:3.0:1788448729.285751:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826450560 00000100:00100000:3.0:1788448729.285765:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826450560 00000100:00100000:3.0:1788448729.286264:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788448729.286276:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:3648:x1875323826450560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448729.286363:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:3648:x1875323826450560:12345-0@lo:400:kworker.0 Request processed in 90us (5947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448729.286370:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448729.286535:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826450560:0@lo:400:kworker.0 00010000:00010000:3.0:1788448729.541988:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448729.987285:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00010000:00010000:1.0:1788448730.558073:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448731.005998:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000040:00080000:0.0:1788448731.007932:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788448731.590622:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448732.035255:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000020:01000004:2.0:1788448732.076757:0:23444:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788448732.076761:0:23444:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788448732.076763:0:23444:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788448732.076997:0:23444:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc083f6a800 00000020:01000004:2.0:1788448732.077013:0:23444:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788448732.077025:0:23444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788448732.077038:0:23444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9fc191388000) 00000020:00000080:2.0:1788448732.077053:0:23444:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788448732.136324:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788448732.136680:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.137457:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.137758:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.138126:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.138346:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.138541:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.139627:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.140019:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.140244:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.140456:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.140706:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.141043:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.141260:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.141480:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.141785:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.142058:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.142384:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.142907:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.143314:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.144210:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.145005:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.145256:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.145474:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.145704:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.146102:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.146317:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.146651:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.147127:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.147326:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.147553:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.147965:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788448732.148403:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.148750:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788448732.151476:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788448732.151918:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788448732.152127:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788448732.152318:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788448732.153667:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788448732.154172:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788448732.154345:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788448732.154672:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788448732.154934:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788448732.155204:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788448732.155376:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788448732.155698:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788448732.156403:0:23444:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788448732.156765:0:23444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788448732.156777:0:23444:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788448732.156788:0:23444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b80518e 00000020:01000004:3.0:1788448732.156795:0:23444:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788448732.156815:0:23444:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788448732.156818:0:23444:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788448732.156824:0:23444:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788448732.156849:0:23444:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788448732.156853:0:23444:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788448732.164503:0:23444:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788448732.164551:0:23444:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.121@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788448732.164556:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788448732.164557:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788448732.164559:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448732.164566:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448732.164567:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448732.164568:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448732.164569:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448732.164571:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448732.164572:0:23444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448732.164575:0:23444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788448732.164577:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448732.164578:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788448732.164579:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448732.164580:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448732.164581:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448732.164582:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448732.164583:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448732.164584:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448732.164585:0:23444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448732.164666:0:23444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788448732.164685:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451200:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788448732.164768:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.164815:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448732.164904:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826451200 00000100:00100000:0.0:1788448732.164913:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826451200 00000100:00100000:0.0:1788448732.164964:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788448732.164983:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:23444:x1875323826451200:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788448732.165011:0:22704:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788448732.165014:0:22704:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788448732.165021:0:22704:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788448732.165630:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:23444:x1875323826451200:12345-0@lo:253:mount.lustre.0 Request processed in 655us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448732.165640:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448732.166165:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451200:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788448732.166178:0:23444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788448732.166180:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788448732.166182:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788448732.166183:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448732.166184:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448732.166185:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448732.166186:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448732.166188:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448732.166198:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448732.166200:0:23444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788448732.166218:0:23444:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc083f6a800 from lustre-MDT0001 10000000:01000000:2.0:1788448732.166246:0:23444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788448732.166248:0:23444:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788448732.166255:0:23444:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc1bb53cd28 local copy 00010000:00010000:2.0:1788448732.166265:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448732.167101:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448732.167149:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.167188:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448732.167542:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826451328 00000100:00100000:3.0:1788448732.167550:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826451328 00000100:00100000:3.0:1788448732.167606:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448732.167616:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:23444:x1875323826451328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448732.167703:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:23444:x1875323826451328:12345-0@lo:501:mount.lustre.0 Request processed in 88us (553us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788448732.167711:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788448732.167927:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451328:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788448732.167944:0:23444:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788448732.167967:0:23444:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788448732.167987:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.167997:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448732.168025:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc083f6a800 10000000:01000000:2.0:1788448732.168030:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788448732.168034:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fc1bb53cd28 10000000:01000000:2.0:1788448732.168037:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788448732.168040:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fc1bb53cd28 from 1 10000000:01000000:2.0:1788448732.168043:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788448732.168068:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5a00/0xf45a9e4e6b805195 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.168076:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5a00/0xf45a9e4e6b805195 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.168085:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5a00/0xf45a9e4e6b805195 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448732.168109:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448732.168138:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.168170:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448732.168963:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826451456 00000100:00100000:1.0:1788448732.168969:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826451456 00000100:00100000:1.0:1788448732.169059:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788448732.169069:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+12:23444:x1875323826451456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448732.169080:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448732.169098:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fcc00/0xf45a9e4e6b80519c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805195 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.169119:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fcc00/0xf45a9e4e6b80519c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805195 expref: 13 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.169130:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fcc00/0xf45a9e4e6b80519c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805195 expref: 13 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.169138:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fcc00, rc 0) 00000100:00100000:1.0:1788448732.169191:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+13:23444:x1875323826451456:12345-0@lo:101:mount.lustre.0 Request processed in 123us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448732.169197:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448732.169273:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448732.169287:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5a00/0xf45a9e4e6b805195 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80519c expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.169296:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5a00/0xf45a9e4e6b805195 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80519c expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448732.169313:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788448732.169336:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5a00/0xf45a9e4e6b805195 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80519c expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.169343:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5a00/0xf45a9e4e6b805195 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80519c expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448732.169351:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc083f6a800 10000000:01000000:2.0:1788448732.169355:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788448732.169359:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc083f6a800 from 1 10000000:01000000:2.0:1788448732.169362:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788448732.169376:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4c00/0xf45a9e4e6b8051a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.169383:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4c00/0xf45a9e4e6b8051a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.169391:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4c00/0xf45a9e4e6b8051a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448732.169412:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448732.169439:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448732.169551:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826451584 00000100:00100000:3.0:1788448732.169556:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826451584 00000100:00100000:2.0:1788448732.169568:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448732.169576:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788448732.169582:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+13:23444:x1875323826451584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448732.169653:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448732.169665:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a9e00/0xf45a9e4e6b8051aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8051a3 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.169680:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a9e00/0xf45a9e4e6b8051aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8051a3 expref: 14 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.169687:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a9e00/0xf45a9e4e6b8051aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8051a3 expref: 14 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.169693:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9e00, rc 0) 00000100:00100000:3.0:1788448732.169746:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+14:23444:x1875323826451584:12345-0@lo:101:mount.lustre.0 Request processed in 164us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448732.169753:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448732.169764:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448732.169787:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4c00/0xf45a9e4e6b8051a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8051aa expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.169795:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4c00/0xf45a9e4e6b8051a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8051aa expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448732.169805:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788448732.169850:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4c00/0xf45a9e4e6b8051a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8051aa expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.169858:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4c00/0xf45a9e4e6b8051a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8051aa expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448732.169864:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788448732.169867:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448732.169872:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc083f6a800 10000000:01000000:2.0:1788448732.169874:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788448732.169877:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788448732.169905:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788448732.169919:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4800/0xf45a9e4e6b8051b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.169926:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4800/0xf45a9e4e6b8051b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.169941:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4800/0xf45a9e4e6b8051b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448732.169954:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448732.169985:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.170003:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448732.170045:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826451712 00000100:00100000:1.0:1788448732.170049:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826451712 00000100:00100000:1.0:1788448732.170116:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788448732.170122:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+14:23444:x1875323826451712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448732.170127:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448732.170133:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fc600/0xf45a9e4e6b8051b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8051b1 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.170143:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fc600/0xf45a9e4e6b8051b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8051b1 expref: 15 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.170148:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fc600/0xf45a9e4e6b8051b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8051b1 expref: 15 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.170152:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fc600, rc 0) 00000100:00100000:1.0:1788448732.170178:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+15:23444:x1875323826451712:12345-0@lo:101:mount.lustre.0 Request processed in 57us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448732.170181:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448732.170228:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448732.170238:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4800/0xf45a9e4e6b8051b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8051b8 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.170246:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4800/0xf45a9e4e6b8051b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8051b8 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448732.171382:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1788448732.172079:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448732.175953:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788448732.176005:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1788448732.176022:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1788448732.176037:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1788448732.176050:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1788448732.176063:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1788448732.176077:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1788448732.176091:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1788448732.176107:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1788448732.176123:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1788448732.176139:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1788448732.176155:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1788448732.176174:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1788448732.176189:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1788448732.176215:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1788448732.176231:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1788448732.176246:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1788448732.176261:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1788448732.176276:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1788448732.176290:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1788448732.176306:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1788448732.176322:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1788448732.176336:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1788448732.176352:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1788448732.176368:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1788448732.176383:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1788448732.176397:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1788448732.176412:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1788448732.176425:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1788448732.176437:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1788448732.176451:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1788448732.176465:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1788448732.176481:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1788448732.176495:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1788448732.176510:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1788448732.176525:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1788448732.176541:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1788448732.176555:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1788448732.176571:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1788448732.176587:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1788448732.176602:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1788448732.176618:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1788448732.176634:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1788448732.176648:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1788448732.176675:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1788448732.176682:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1788448732.176793:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448732.176863:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.176939:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448732.177162:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826451840 00000100:00100000:0.0:1788448732.177169:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826451840 00000100:00100000:0.0:1788448732.177218:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788448732.177227:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+15:23444:x1875323826451840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448732.177368:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+15:23444:x1875323826451840:12345-0@lo:501:mount.lustre.0 Request processed in 141us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448732.177377:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448732.177516:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448732.177549:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448732.177658:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.177784:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788448732.177877:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826451968 00000100:00100000:1.0:1788448732.178198:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826451968 00000100:00100000:1.0:1788448732.178275:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788448732.178284:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+15:23444:x1875323826451968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448732.179041:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+15:23444:x1875323826451968:12345-0@lo:503:mount.lustre.0 Request processed in 757us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448732.179050:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448732.179129:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826451968:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788448732.179518:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448732.179589:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826452096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448732.179647:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.180002:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448732.180080:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826452096 00000100:00100000:0.0:1788448732.180086:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826452096 00000100:00100000:0.0:1788448732.180118:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788448732.180126:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+15:23444:x1875323826452096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448732.180729:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+15:23444:x1875323826452096:12345-0@lo:502:mount.lustre.0 Request processed in 602us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448732.180738:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788448732.180827:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826452096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448732.181045:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788448732.181071:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788448732.181086:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788448732.181099:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788448732.181112:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788448732.181127:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788448732.181141:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788448732.181155:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788448732.181168:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788448732.181181:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788448732.181194:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788448732.181208:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788448732.181221:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788448732.181233:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788448732.181245:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788448732.181271:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788448732.181284:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788448732.181296:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788448732.181308:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788448732.181319:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1788448732.181331:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1788448732.181343:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1788448732.181367:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1788448732.181383:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1788448732.181397:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1788448732.181409:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1788448732.181420:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1788448732.181432:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1788448732.181444:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1788448732.181455:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1788448732.181466:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1788448732.181477:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1788448732.181488:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1788448732.181499:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1788448732.181513:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1788448732.181527:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1788448732.181541:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1788448732.181553:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1788448732.181581:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1788448732.181743:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1788448732.181760:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1788448732.181775:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1788448732.181789:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1788448732.181802:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1788448732.181833:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826452224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448732.181909:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.181936:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448732.182004:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826452224 00000100:00100000:0.0:1788448732.182010:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826452224 00000100:00100000:0.0:1788448732.182038:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788448732.182046:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+15:23444:x1875323826452224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448732.182142:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+15:23444:x1875323826452224:12345-0@lo:502:mount.lustre.0 Request processed in 96us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448732.182150:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448732.182236:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826452224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448732.182278:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788448732.182285:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788448732.183015:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448732.183025:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448732.183027:0:23448:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788448732.183033:0:23448:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788448732.183036:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788448732.183048:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9fc19ebe8000) 00000020:00000080:0.0:1788448732.183067:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788448732.183073:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788448732.183162:0:23448:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788448732.183170:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b8051c6 00000020:00000080:0.0:1788448732.183352:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788448732.183357:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448732.183361:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448732.183362:0:23448:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788448732.183365:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448732.183368:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448732.183370:0:23448:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788448732.183373:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788448732.183380:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9fc19ebecd28) 00000020:00000080:0.0:1788448732.183390:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788448732.183394:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788448732.183396:0:23448:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788448732.183398:0:23448:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788448732.183404:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788448732.183455:0:23448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc083f6a800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788448732.183476:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9fc1b53a19b8) 00000020:00000080:0.0:1788448732.183486:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788448732.183537:0:23448:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788448732.183542:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b8051db 00000020:00000080:0.0:1788448732.183641:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788448732.183647:0:23448:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788448732.183651:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf45a9e4e6b8051e2 00080000:01000000:0.0:1788448732.183657:0:23448:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788448732.183660:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b8051e9 00010000:00010000:2.0:1788448732.252923:0:23448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788448732.253398:0:23448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788448732.253683:0:23448:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788448732.254583:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788448732.254604:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448732.254609:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448732.254612:0:23448:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788448732.254615:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448732.254619:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448732.254621:0:23448:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788448732.254624:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788448732.254633:0:23448:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:00000080:0.0:1788448732.254658:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788448732.254671:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9fc1b53a4d28) 00000020:00000080:0.0:1788448732.254689:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788448732.254694:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788448732.254760:0:23448:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788448732.254765:0:23448:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788448732.254783:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b8051f7 00010000:00080000:0.0:1788448732.254810:0:23448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc182d6e000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448732.256410:0:23448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788448732.258173:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788448732.258189:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788448732.258225:0:23448:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788448732.258245:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b8051fe 00000100:00080000:0.0:1788448732.258255:0:23448:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448732.258260:0:23448:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc182d6e000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448732.258292:0:23448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bff09500 x1875323826452352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448732.258324:0:23448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788448732.258373:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448732.258376:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448732.258378:0:23448:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788448732.258380:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788448732.258383:0:23448:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788448732.258384:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788448732.258386:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788448732.258388:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788448732.258390:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448732.258392:0:23448:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788448732.258395:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448732.258399:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448732.258406:0:23448:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788448732.258411:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788448732.258443:0:23448:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788448732.258456:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448732.258460:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448732.258461:0:23448:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788448732.258463:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788448732.258465:0:23448:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788448732.258466:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788448732.258467:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788448732.258469:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788448732.258471:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448732.258472:0:23448:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788448732.258474:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788448732.258477:0:23448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788448732.258481:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448732.258482:0:23448:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788448732.258485:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788448732.258488:0:23448:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:0.0:1788448732.258509:0:23448:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788448732.258512:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788448732.258523:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9fc1b53a0000) 00000020:00000080:0.0:1788448732.258534:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788448732.258538:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1788448732.258699:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826452352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448732.258778:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.258833:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826452352 00000100:00100000:2.0:1788448732.258839:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826452352 00000100:00100000:2.0:1788448732.258867:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448732.258874:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826452352:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788448732.258920:0:22716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:2.0:1788448732.258946:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b80520c 00000004:00100000:2.0:1788448732.258964:0:22716:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788448732.258968:0:22716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000004:00080000:0.0:1788448732.259144:0:23448:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788448732.259153:0:23448:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788448732.259161:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b805213 00010000:00080000:0.0:1788448732.259198:0:23448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc1bb74f000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448732.259435:0:23448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1788448732.259692:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788448732.259697:0:16256:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788448732.259700:0:16256:0:(import.c:65:import_set_state_nolock()) ffff9fc1852d4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448732.259705:0:16256:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:3.0:1788448732.259708:0:16256:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788448732.259722:0:16256:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc1852d4800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448732.259744:0:16256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1b6563480 x1875323826452480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448732.259776:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448732.259787:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448732.259790:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448732.259793:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788448732.260165:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826452480:0@lo:38:kworker.0 00000100:00100000:2.0:1788448732.260209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448732.262202:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826452608:0@lo:400:kworker.0 00000100:00100000:1.0:1788448732.262267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448732.262327:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826452608 00000100:00100000:1.0:1788448732.262344:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826452608 00000100:00100000:1.0:1788448732.262406:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448732.262416:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826452608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448732.262483:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826452608:12345-0@lo:400:kworker.0 Request processed in 56us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448732.262491:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788448732.262533:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc1b6560e00 x1875323826452608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448732.262547:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826452608:0@lo:400:kworker.0 00000040:01000000:0.0:1788448732.264087:0:23448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788448732.265044:0:23448:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788448732.265304:0:22715:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788448732.265314:0:22715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788448732.266091:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826452480 00000100:00100000:2.0:1788448732.266102:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826452480 00000100:00100000:3.0:1788448732.266378:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448732.266387:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1875323826452480:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788448732.266483:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1875323826452480:12345-0@lo:38:kworker.0 Request processed in 95us (6272us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788448732.266490:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448732.266664:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448732.266673:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1852d4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448732.266677:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788448732.266681:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826452480:0@lo:38:kworker.0 00000100:00080000:3.0:1788448732.267098:0:22716:0:(import.c:65:import_set_state_nolock()) ffff9fc0834f8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448732.267146:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875323826452352:12345-0@lo:38:llog_process_th.0 Request processed in 8270us (8367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448732.267153:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448732.267219:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448732.267226:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788448732.267241:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788448732.267246:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788448732.267249:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc182d6e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448732.267266:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826452352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448732.267608:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826452736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448732.267645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448732.271427:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826452736 00000100:00100000:3.0:1788448732.271439:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826452736 00000100:00100000:3.0:1788448732.271495:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788448732.271507:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875323826452736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448732.271539:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788448732.271630:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875323826452736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (3984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448732.271638:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788448732.271734:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826452736:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788448732.274962:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448732.275612:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788448732.275751:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788448732.283335:0:23454:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788448732.283342:0:23454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788448732.284222:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788448732.284235:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788448732.284274:0:23448:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788448732.284293:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b80521a 00000100:00080000:2.0:1788448732.284303:0:23448:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788448732.284308:0:23448:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc1bb74f000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448732.284340:0:23448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1ba34ce00 x1875323826452864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788448732.284364:0:23448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788448732.284419:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448732.284423:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448732.284425:0:23448:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788448732.284428:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788448732.284430:0:23448:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788448732.284432:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788448732.284433:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788448732.284444:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788448732.284446:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448732.284447:0:23448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788448732.284450:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788448732.284454:0:23448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788448732.284457:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448732.284458:0:23448:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788448732.284461:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788448732.284464:0:23448:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:2.0:1788448732.284501:0:23448:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788448732.284504:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448732.284514:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9fc19138b370) 00000020:00000080:2.0:1788448732.284527:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788448732.284532:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788448732.284608:0:23448:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788448732.284615:0:23448:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788448732.284621:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b805228 00010000:00080000:2.0:1788448732.284657:0:23448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc188773000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.121@tcp at head 00010000:00010000:2.0:1788448732.284878:0:23448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788448732.284972:0:23448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788448732.284986:0:23448:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1788448732.286388:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448732.286395:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448732.286397:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448732.286400:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788448732.287339:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826452864:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788448732.287400:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826452864 offset 0 length 520: 4 00000040:00080000:2.0:1788448732.289023:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448732.290946:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788448732.291111:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1788448732.292971:0:23456:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788448732.292977:0:23456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788448732.294364:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788448732.294378:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788448732.294418:0:23448:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788448732.294439:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b80522f 00000100:00080000:1.0:1788448732.294451:0:23448:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448732.294457:0:23448:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc188773000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448732.294505:0:23448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083e4d180 x1875323826452992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448732.294533:0:23448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788448732.294963:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448732.294969:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448732.294971:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448732.294984:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788448732.295056:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448732.295066:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448732.295069:0:23448:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788448732.295073:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448732.295077:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448732.295078:0:23448:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788448732.295081:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788448732.295082:0:23448:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788448732.295084:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448732.295086:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448732.295087:0:23448:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788448732.295090:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448732.295092:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448732.295093:0:23448:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788448732.295096:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788448732.295125:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448732.295129:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448732.295130:0:23448:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788448732.295133:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:0.0:1788448732.295306:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826452992:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788448732.295358:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826452992 offset 0 length 520: 4 00000020:01000000:3.0:1788448732.295443:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788448732.295483:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788448732.295503:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4800/0xf45a9e4e6b8051b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8051b8 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.295513:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4800/0xf45a9e4e6b8051b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8051b8 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448732.295520:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc083f6a800 from 1 10000000:01000000:3.0:1788448732.295523:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788448732.295548:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.295556:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.295566:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448732.295581:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788448732.295638:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448732.295663:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969e8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788448732.296022:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826453120 00000100:00100000:1.0:1788448732.296029:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826453120 00000100:00100000:1.0:1788448732.296071:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788448732.296079:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+15:23444:x1875323826453120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448732.296090:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448732.296101:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fd800/0xf45a9e4e6b80523d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805236 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.296121:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fd800/0xf45a9e4e6b80523d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805236 expref: 16 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.296130:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fd800/0xf45a9e4e6b80523d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805236 expref: 16 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.296138:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd800, rc 0) 00000100:00100000:1.0:1788448732.296190:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+16:23444:x1875323826453120:12345-0@lo:101:mount.lustre.0 Request processed in 112us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448732.296197:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788448732.296322:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448732.296336:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.296344:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448732.297271:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453248:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788448732.297327:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448732.297356:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969e8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788448732.297555:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826453248 00000100:00100000:1.0:1788448732.297561:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826453248 00000100:00100000:1.0:1788448732.297724:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788448732.297743:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+16:23444:x1875323826453248:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788448732.297761:0:22703:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788448732.297789:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788448732.297793:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788448732.297905:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+16:23444:x1875323826453248:12345-0@lo:256:mount.lustre.0 Request processed in 164us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448732.297913:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788448732.297993:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453248:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788448732.298612:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788448732.298632:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.298642:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448732.298660:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc083f6a800 from 1 10000000:01000000:2.0:1788448732.298663:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448732.298686:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.298694:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.298702:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448732.298729:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448732.298772:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.299508:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08355de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448732.299659:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826453376 00000100:00100000:0.0:1788448732.299666:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826453376 00000100:00100000:0.0:1788448732.299721:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448732.299730:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+16:23444:x1875323826453376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448732.299742:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448732.299755:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b80524b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805244 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448732.299913:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b80524b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805244 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448732.299925:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b80524b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805244 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448732.299933:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f000, rc 0) 00000100:00100000:0.0:1788448732.299971:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:23444:x1875323826453376:12345-0@lo:101:mount.lustre.0 Request processed in 243us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448732.299978:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788448732.300062:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448732.300076:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.300084:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448732.301216:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788448732.301449:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448732.301615:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788448732.301638:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788448732.301650:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788448732.301663:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788448732.301675:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788448732.301720:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788448732.301737:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788448732.301749:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788448732.301761:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788448732.301985:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788448732.302001:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788448732.302016:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788448732.302020:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788448732.302080:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448732.302136:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.302166:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08355db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448732.302237:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826453504 00000100:00100000:0.0:1788448732.302242:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826453504 00000100:00100000:0.0:1788448732.302275:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788448732.302283:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:23444:x1875323826453504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448732.302394:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:23444:x1875323826453504:12345-0@lo:501:mount.lustre.0 Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448732.302414:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788448732.303030:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448732.303065:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448732.303114:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.303145:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08355db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448732.303197:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826453632 00000100:00100000:0.0:1788448732.303202:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826453632 00000100:00100000:0.0:1788448732.303223:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788448732.303229:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:23444:x1875323826453632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448732.303327:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:23444:x1875323826453632:12345-0@lo:503:mount.lustre.0 Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448732.303333:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448732.303411:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453632:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788448732.304256:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448732.304321:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448732.304374:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.306025:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448732.306106:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826453760 00000100:00100000:1.0:1788448732.306114:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826453760 00000100:00100000:3.0:1788448732.306206:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788448732.306218:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:23444:x1875323826453760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448732.306357:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:23444:x1875323826453760:12345-0@lo:502:mount.lustre.0 Request processed in 140us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448732.306364:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788448732.306444:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448732.306669:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788448732.306700:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788448732.306726:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788448732.306741:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788448732.306753:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788448732.306765:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788448732.306801:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788448732.306816:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788448732.306828:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788448732.306840:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788448732.306853:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788448732.306903:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453888:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448732.306956:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.307337:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448732.307373:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826453888 00000100:00100000:0.0:1788448732.307378:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826453888 00000100:00100000:0.0:1788448732.307409:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788448732.307417:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:23444:x1875323826453888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448732.307527:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:23444:x1875323826453888:12345-0@lo:502:mount.lustre.0 Request processed in 110us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448732.307534:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788448732.307620:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826453888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448732.307664:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788448732.307672:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788448732.308523:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448732.308532:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448732.308534:0:23458:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788448732.308541:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc083f6a800 00000020:00000080:2.0:1788448732.308543:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788448732.308550:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448732.308552:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448732.308553:0:23458:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788448732.308555:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448732.308558:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448732.308559:0:23458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788448732.308563:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc083f6a800 00000020:00000080:2.0:1788448732.308565:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788448732.308705:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448732.308709:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448732.308710:0:23458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788448732.308723:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448732.308726:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448732.308727:0:23458:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788448732.308731:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc083f6a800 00000020:00000080:2.0:1788448732.308738:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788448732.308758:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448732.308761:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448732.308762:0:23458:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788448732.310551:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448732.310563:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448732.310565:0:23458:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788448732.310575:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc083f6a800 00000020:00000080:2.0:1788448732.310577:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788448732.310644:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448732.310648:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448732.310650:0:23458:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788448732.310653:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1788448732.310920:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788448732.310949:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448732.310966:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.310977:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448732.311024:0:23444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788448732.311027:0:23444:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc083f6a800 10000000:01000000:2.0:1788448732.311030:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc083f6a800 10000000:01000000:2.0:1788448732.311033:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448732.311039:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc083f6a800 from 1 10000000:01000000:2.0:1788448732.311041:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788448732.311071:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b805252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.311078:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b805252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.311099:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b805252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448732.311120:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448732.311191:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.311227:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448732.314866:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826454016 00000100:00100000:3.0:1788448732.314889:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826454016 00000100:00100000:3.0:1788448732.314955:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788448732.314967:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:23444:x1875323826454016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448732.314984:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448732.315002:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8800/0xf45a9e4e6b805259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805252 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.315028:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8800/0xf45a9e4e6b805259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805252 expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.315038:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8800/0xf45a9e4e6b805259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805252 expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.315048:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8800, rc 0) 00000100:00100000:3.0:1788448732.315112:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454016:12345-0@lo:101:mount.lustre.0 Request processed in 148us (3921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448732.315118:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788448732.315653:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448732.315671:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b805252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805259 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.315682:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b805252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805259 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448732.317173:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788448732.317440:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448732.320302:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788448732.320355:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788448732.320380:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788448732.320396:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788448732.320409:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788448732.320422:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788448732.320435:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788448732.320450:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788448732.320470:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788448732.320485:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788448732.320499:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788448732.320512:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788448732.320544:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788448732.320571:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788448732.320913:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788448732.320943:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788448732.320958:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788448732.320972:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788448732.320983:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788448732.320995:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788448732.321008:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788448732.321021:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788448732.321035:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788448732.321047:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788448732.321060:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788448732.321074:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788448732.321088:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788448732.321101:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788448732.321127:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788448732.321143:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788448732.321156:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788448732.321170:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788448732.321183:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788448732.321196:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788448732.321211:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788448732.321225:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788448732.321238:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788448732.321249:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788448732.321262:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788448732.321275:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788448732.321287:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788448732.321298:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788448732.321309:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788448732.321320:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788448732.321347:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788448732.321363:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788448732.321387:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788448732.321403:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788448732.322995:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788448732.323037:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788448732.323058:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788448732.323063:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788448732.323162:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448732.323231:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.323270:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448732.323579:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826454144 00000100:00100000:1.0:1788448732.323596:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826454144 00000100:00100000:1.0:1788448732.323640:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788448732.323650:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448732.323925:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454144:12345-0@lo:501:mount.lustre.0 Request processed in 275us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448732.323933:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448732.324231:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448732.324268:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448732.324320:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.324356:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448732.324466:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826454272 00000100:00100000:1.0:1788448732.324471:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826454272 00000100:00100000:1.0:1788448732.324504:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788448732.324513:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448732.324613:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454272:12345-0@lo:503:mount.lustre.0 Request processed in 101us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448732.324629:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448732.325710:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454272:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788448732.326159:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448732.326234:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448732.326296:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.326325:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448732.326462:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826454400 00000100:00100000:3.0:1788448732.326468:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826454400 00000100:00100000:3.0:1788448732.326508:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448732.326516:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448732.326621:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454400:12345-0@lo:502:mount.lustre.0 Request processed in 105us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448732.326628:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788448732.326941:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448732.327093:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788448732.327119:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788448732.327133:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788448732.327146:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788448732.327160:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788448732.327173:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788448732.327203:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788448732.327219:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788448732.327243:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788448732.327256:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788448732.327270:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788448732.327283:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788448732.327297:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788448732.327310:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788448732.327324:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788448732.327337:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788448732.327349:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788448732.327361:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788448732.327373:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788448732.327387:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788448732.327400:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788448732.327413:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788448732.327437:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788448732.327452:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788448732.327464:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788448732.327475:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788448732.327487:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788448732.327500:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788448732.327513:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788448732.327525:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788448732.327537:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788448732.327548:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788448732.327561:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788448732.327573:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788448732.327585:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788448732.328489:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788448732.328519:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788448732.328531:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788448732.328552:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788448732.328564:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788448732.328574:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788448732.328602:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788448732.328615:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788448732.328626:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788448732.328636:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788448732.328647:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788448732.328658:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788448732.328668:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788448732.328708:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448732.328795:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.334214:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448732.334288:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826454528 00000100:00100000:3.0:1788448732.334298:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826454528 00000100:00100000:3.0:1788448732.334394:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788448732.334404:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448732.334555:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454528:12345-0@lo:502:mount.lustre.0 Request processed in 152us (5759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448732.334562:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788448732.334831:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448732.335113:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788448732.335140:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788448732.335170:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448732.335223:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.335250:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826454656 00000100:00100000:2.0:1788448732.335254:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826454656 00000100:00100000:2.0:1788448732.335280:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788448732.335287:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448732.335356:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454656:12345-0@lo:502:mount.lustre.0 Request processed in 68us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448732.335362:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788448732.335403:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448732.335417:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448732.335451:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788448732.335458:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788448732.336857:0:23463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788448732.336872:0:23463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9fc1b53a3370) 00000020:00000080:0.0:1788448732.336921:0:23463:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788448732.337021:0:23463:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc083f6a800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788448732.337025:0:23463:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc083f6a800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788448732.337028:0:23463:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc083f6a800 3 00010000:00080000:0.0:1788448732.337053:0:23463:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc1a5015000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448732.343515:0:23463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788448732.343989:0:23463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788448732.344034:0:23463:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788448732.344047:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf45a9e4e6b805267 00000100:00080000:0.0:1788448732.344056:0:23463:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448732.344069:0:23463:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fc1a5015000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448732.344102:0:23463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bff09180 x1875323826454784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788448732.344159:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826454784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448732.344230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788448732.344292:0:23463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788448732.347710:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826454784 00000100:00100000:2.0:1788448732.347733:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826454784 00000100:00100000:2.0:1788448732.348703:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448732.348724:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826454784:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788448732.348755:0:22712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:2.0:1788448732.349505:0:22712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf45a9e4e6b80526e 00000004:00100000:2.0:1788448732.349524:0:22712:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788448732.349558:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448732.349720:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875323826454784:12345-0@lo:38:llog_process_th.0 Request processed in 997us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448732.349729:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788448732.349876:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc1bff09180 x1875323826454784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448732.349901:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448732.349909:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788448732.349916:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788448732.349921:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788448732.349924:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1a5015000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448732.349929:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826454784:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788448732.350481:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448732.350487:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448732.350490:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448732.350493:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788448732.351199:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1788448732.351682:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788448732.351709:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788448732.351842:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b805252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805259 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.351854:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b805252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805259 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788448732.351928:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788448732.351931:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788448732.351932:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448732.351934:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448732.351935:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448732.351936:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448732.351938:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788448732.351940:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448732.351941:0:23444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788448732.351945:0:23444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788448732.351948:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788448732.351949:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788448732.351950:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448732.351951:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448732.351952:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448732.351953:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448732.351954:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788448732.351955:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448732.351956:0:23444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788448732.351978:0:23444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788448732.351995:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788448732.352064:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448732.352096:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969e8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788448732.355683:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826454912 00000100:00100000:2.0:1788448732.355698:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826454912 00000100:00100000:2.0:1788448732.358720:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788448732.358738:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:23444:x1875323826454912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788448732.358771:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788448732.358789:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788448732.360411:0:22690:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788448732.360453:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788448732.360461:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788448732.360472:0:22726:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788448732.360481:0:22726:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788448732.360500:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.360520:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805172 expref: 18 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.360528:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc0824fd800/0xf45a9e4e6b80523d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805236 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.360535:0:22726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.360572:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc0824fd800/0xf45a9e4e6b80523d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b805236 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.360585:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc0824fd800/0xf45a9e4e6b80523d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b805236 expref: 18 pid: 22705 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448732.360724:0:22726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826455040:0@lo:104: 00000100:00100000:2.0:1788448732.360791:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448732.360836:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b805172 expref: 18 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.360845:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805179 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b805172 expref: 18 pid: 22703 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448732.360867:0:22726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826455168:0@lo:104: 00000100:00100000:2.0:1788448732.360908:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.360928:0:22726:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788448732.360960:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826455040 00000100:00100000:2.0:1788448732.360966:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826455040 00000100:00100000:2.0:1788448732.360992:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826455168 00000100:00100000:2.0:1788448732.360995:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826455168 00000100:00100000:2.0:1788448732.361008:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448732.361016:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+4:22726:x1875323826455040:12345-0@lo:104: 00010000:00010000:2.0:1788448732.361028:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361075:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448732.361080:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+4:22726:x1875323826455040:12345-0@lo:104: Request processed in 65us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448732.361087:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448732.361101:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448732.361108:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:22726:x1875323826455168:12345-0@lo:104: 00010000:00010000:2.0:1788448732.361114:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361145:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788448732.361150:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:22726:x1875323826455168:12345-0@lo:104: Request processed in 44us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448732.361156:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448732.361185:0:22726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826455040:0@lo:104: 00000100:00100000:2.0:1788448732.361205:0:22726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826455168:0@lo:104: 00010000:00010000:2.0:1788448732.361223:0:22726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361239:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448732.361244:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361250:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448732.361254:0:22698:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361262:0:22698:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448732.361268:0:22698:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448732.361273:0:22698:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448732.361296:0:22698:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361301:0:22698:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448732.361316:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361322:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9200/0xf45a9e4e6b805236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80523d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361330:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448732.361338:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361343:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fdc00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448732.361346:0:22698:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361351:0:22698:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448732.361357:0:22698:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448732.361361:0:22698:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448732.361374:0:22698:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361503:0:22698:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448732.361527:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448732.361534:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc0824fdc00/0xf45a9e4e6b805172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805179 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448732.361545:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826455424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448732.361546:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448732.361547:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448732.361549:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448732.361554:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448732.361569:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826455296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448732.361576:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.361659:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448732.361731:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826455424 00000100:00100000:2.0:1788448732.361735:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826455424 00000100:00100000:1.0:1788448732.361735:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826455296 00000100:00100000:1.0:1788448732.361738:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826455296 00010000:00010000:2.0:1788448732.361752:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805179 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805172 expref: 20 pid: 22703 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361752:0:22695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc0824fd800/0xf45a9e4e6b80523d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805236 expref: 20 pid: 22705 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448732.361773:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448732.361779:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:3648:x1875323826455296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448732.361787:0:22695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448732.361793:0:22695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc0824fd800/0xf45a9e4e6b80523d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805236 expref: 20 pid: 22705 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361802:0:22695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc0824fd800/0xf45a9e4e6b80523d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b805236 expref: 20 pid: 22705 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361815:0:22695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fd800/0xf45a9e4e6b80523d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b805236 expref: 20 pid: 22705 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361826:0:22695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448732.361857:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:3648:x1875323826455296:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448732.361862:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448732.361876:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448732.361897:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:3645:x1875323826455424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448732.361905:0:22695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788448732.361912:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826455296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448732.361915:0:22695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805179 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805172 expref: 18 pid: 22703 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361924:0:22695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b805172 expref: 18 pid: 22703 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361932:0:22695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b805172 expref: 18 pid: 22703 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361943:0:22695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361949:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788448732.361960:0:22695:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003688352s 00010000:00010000:1.0:1788448732.361964:0:22695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361970:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361976:0:22695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361983:0:22695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.361988:0:22695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e4600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448732.361992:0:22695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.362011:0:22695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.362033:0:22695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448732.362042:0:22695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448732.362070:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:3645:x1875323826455424:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448732.362077:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788448732.362098:0:22726:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448732.362102:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826455424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448732.362107:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448732.362113:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1871e4600/0xf45a9e4e6b805275 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448732.375936:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+16:23444:x1875323826454912:12345-0@lo:253:mount.lustre.0 Request processed in 17196us (23864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448732.375937:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:23444:1875323826454912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788448732.375953:0:23444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788448732.375956:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788448732.375958:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000100:00100000:3.0:1788448732.375959:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000020:01000004:0.0:1788448732.375959:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448732.375961:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448732.375962:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448732.375963:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448732.375964:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448732.375966:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448732.375968:0:23444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788448732.375980:0:23444:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:3.0:1788448732.384533:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788448732.384535:0:23470:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788448732.384539:0:23470:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788448732.384922:0:23471:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788448732.384925:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1788448732.386050:0:23471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448732.389162:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875323826455552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788448732.389232:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448732.389268:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448732.389317:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826455552 00000100:00100000:2.0:1788448732.389325:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826455552 00000100:00100000:2.0:1788448732.389374:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788448732.389393:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23472:x1875323826455552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788448732.389465:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23472:x1875323826455552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 73us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448732.389484:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448732.389681:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875323826455552:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788448732.389709:0:23472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788448732.389743:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875323826455680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788448732.389836:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448732.389861:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448732.389917:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826455680 00000100:00100000:2.0:1788448732.389922:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826455680 00000100:00100000:2.0:1788448732.389946:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448732.389952:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23472:x1875323826455680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788448732.390071:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23472:x1875323826455680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448732.390077:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448732.390143:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875323826455680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788448732.390194:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23472:1875323826455808:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788448732.390223:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448732.390245:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788448732.390299:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826455808 00000100:00100000:2.0:1788448732.390303:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826455808 00000100:00100000:2.0:1788448732.390367:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448732.390375:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23472:x1875323826455808:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788448732.390423:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23472:x1875323826455808:12345-0@lo:900:lod0001_rec0000.0 Request processed in 50us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448732.390435:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1788448732.390619:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788448732.390656:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788448732.391305:0:23444:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788448732.391313:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788448732.391357:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448732.392309:0:23444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788448732.392943:0:23444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788448732.392972:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788448732.393112:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448732.393116:0:23471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788448732.393186:0:23471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00010000:00080000:1.0:1788448732.394014:0:23472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc083e4ea00 x1875323826455808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788448748 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448732.394048:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23472:1875323826455808:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788448732.394115:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875323826455936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788448732.394170:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448732.394203:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448732.395539:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826455936 00000100:00100000:3.0:1788448732.395549:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826455936 00000100:00100000:3.0:1788448732.395590:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788448732.395600:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23472:x1875323826455936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788448732.395744:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23472:x1875323826455936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 145us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448732.395752:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448732.395840:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875323826455936:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788448732.395921:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788448732.398171:0:23444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:1.0:1788448732.399933:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788448732.399997:0:23472:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788448732.400001:0:23472:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1788448732.401345:0:23444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788448732.403270:0:23444:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788448732.403311:0:23444:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbf8c01a33988 00100000:10000000:0.0:1788448732.403318:0:23444:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788448732.404046:0:23444:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788448732.404075:0:23444:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788448732.404094:0:23444:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788448732.404115:0:23444:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788448732.406053:0:23444:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788448732.406268:0:23444:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788448732.609076:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448733.054007:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000040:00080000:0.0:1788448733.374541:0:23467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788448733.631373:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788448733.694156:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788448733.694164:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc083f6a800 from 12 10000000:01000000:2.0:1788448733.694170:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788448733.694221:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448733.694232:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448733.694243:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448733.694267:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826456064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448733.694343:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448733.694441:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448733.696405:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826456064 00000100:00100000:3.0:1788448733.696419:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826456064 00000100:00100000:0.0:1788448733.696694:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788448733.696718:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+16:22707:x1875323826456064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448733.696757:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448733.696778:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805283 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80527c expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448733.696805:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80527c expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448733.696816:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80527c expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448733.696824:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f600, rc 0) 00000100:00100000:0.0:1788448733.696917:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:22707:x1875323826456064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448733.696924:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788448733.697026:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826456064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448733.697044:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448733.697053:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448733.697129:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826456192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788448733.697177:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448733.699074:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826456192 00000100:00100000:3.0:1788448733.699086:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826456192 00000100:00100000:3.0:1788448733.699135:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448733.699143:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:22707:x1875323826456192:12345-0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788448733.699151:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d240 going to sleep for 11 seconds 20000000:01000000:3.0:1788448733.699162:0:22703:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788448733.699192:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788448733.699195:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788448733.699478:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:22707:x1875323826456192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 315us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448733.699486:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788448733.699700:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826456192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788448733.699772:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788448733.699782:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448733.699791:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448733.699801:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788448733.699804:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc1bfee5000 from 12 10000000:01000000:2.0:1788448733.699807:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788448733.699833:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448733.699841:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448733.699850:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448733.699866:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826456320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448733.700016:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448733.700135:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448733.700174:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826456320 00000100:00100000:0.0:1788448733.700180:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826456320 00000100:00100000:0.0:1788448733.700445:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788448733.700454:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:22707:x1875323826456320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448733.700464:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448733.700476:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b805291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80528a expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448733.700497:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b805291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80528a expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448733.700506:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b805291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80528a expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448733.700676:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e400, rc 0) 00000100:00100000:0.0:1788448733.700763:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:22707:x1875323826456320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 309us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448733.700769:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788448733.700829:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826456320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448733.700842:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448733.700851:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448733.700929:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826456448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788448733.700966:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448733.701036:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448733.701071:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826456448 00000100:00100000:3.0:1788448733.701076:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826456448 00000100:00100000:3.0:1788448733.701154:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788448733.701189:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:22707:x1875323826456448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788448733.701202:0:22703:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788448733.701227:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788448733.701230:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788448733.701330:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:22707:x1875323826456448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448733.701337:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788448733.701397:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826456448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788448733.701434:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788448733.701440:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448733.701448:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448734.077978:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000040:00080000:0.0:1788448734.399167:0:23467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788448734.658508:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448735.102113:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00010000:00010000:1.0:1788448735.678105:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448736.125952:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000001:02000400:3.0:1788448736.602732:0:23714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788448736.703419:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448737.150027:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 0 seconds 00000100:00100000:1.0:1788448737.470588:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826456576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448737.470652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448737.470718:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826456576 00000100:00100000:1.0:1788448737.470726:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826456576 00000100:00100000:1.0:1788448737.470767:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788448737.470776:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826456576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448737.470809:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788448737.470861:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826456576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448737.470868:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788448737.470965:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826456576:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788448737.473214:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788448737.473221:0:16256:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788448737.473224:0:16256:0:(import.c:65:import_set_state_nolock()) ffff9fc1852d4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448737.473234:0:16256:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc1852d4800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448737.473256:0:16256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1b6562a00 x1875323826456832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448737.473268:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448737.473271:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448737.473273:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448737.473276:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448737.473286:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448737.473290:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448737.473292:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448737.473295:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448737.473377:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3647:1875323826456704:0@lo:400:kworker.0 00000100:00100000:0.0:1788448737.473545:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826456832:0@lo:38:kworker.0 00000100:00100000:0.0:1788448737.473603:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448737.473715:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448737.473753:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448737.473759:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826456960:0@lo:400:kworker.0 00000100:00100000:3.0:1788448737.473787:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448737.473817:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826456832 00000100:00100000:3.0:1788448737.473823:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826456832 00000100:00100000:3.0:1788448737.473850:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448737.473857:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1875323826456832:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788448737.473898:0:23453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:3.0:1788448737.473938:0:23453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b805298 00000004:00100000:3.0:1788448737.473952:0:23453:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788448737.473958:0:23453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788448737.474028:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826456960 00000100:00100000:3.0:1788448737.474032:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826456960 00000100:00100000:3.0:1788448737.474062:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448737.474068:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826456960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448737.474111:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826456960:12345-0@lo:400:kworker.0 Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448737.474118:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788448737.474283:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc1b6561f80 x1875323826456960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448737.474296:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826456960:0@lo:400:kworker.0 00000100:00100000:3.0:1788448737.474318:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826457088:0@lo:400:kworker.0 00000100:00100000:3.0:1788448737.474346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448737.474503:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826457088 00000100:00100000:3.0:1788448737.474507:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826457088 00000100:00100000:3.0:1788448737.474530:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448737.474536:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826457088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448737.474571:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826457088:12345-0@lo:400:kworker.0 Request processed in 35us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448737.474577:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788448737.474603:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc1b6560000 x1875323826457088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448737.474613:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826457088:0@lo:400:kworker.0 00000100:00100000:0.0:1788448737.474697:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826456704 00000100:00100000:0.0:1788448737.474702:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826456704 00000100:00100000:0.0:1788448737.474734:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788448737.474741:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:3647:x1875323826456704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448737.474817:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:3647:x1875323826456704:12345-0@lo:400:kworker.0 Request processed in 77us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448737.474824:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788448737.477262:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3647:1875323826456704:0@lo:400:kworker.0 00000100:00080000:3.0:1788448737.482405:0:23453:0:(import.c:65:import_set_state_nolock()) ffff9fc1a5179800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448737.482499:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875323826456832:12345-0@lo:38:kworker.0 Request processed in 8640us (8894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448737.482509:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788448737.482539:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788448737.482549:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788448737.482554:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788448737.482557:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1852d4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788448737.482670:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000075e57d7e): req@ffff9fc1ba34df80 x1875323826449792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000020:00000004:0.0:1788448737.483089:0:23766:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448737.483530:0:23766:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788448737.485718:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448737.485741:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826457216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448737.485813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448737.485862:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826457216 00000100:00100000:3.0:1788448737.485870:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826457216 00000100:00100000:3.0:1788448737.486324:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448737.486335:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826457216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448737.486367:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788448737.487157:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448737.487185:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448737.487321:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826457216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 986us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448737.487329:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448737.487360:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826449792 00000100:00100000:3.0:1788448737.487365:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826449792 00000100:00100000:3.0:1788448737.487397:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448737.487404:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22752:x1875323826449792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448737.487486:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22752:x1875323826449792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 82us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448737.487493:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448737.487536:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22752:1875323826449792:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788448737.487571:0:22752:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788448737.487604:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6561500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22752:1875323826457344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448737.487633:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448737.487647:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448737.487659:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826457344 00000100:00100000:3.0:1788448737.487662:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826457344 00000100:00100000:3.0:1788448737.487679:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448737.487698:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22752:x1875323826457344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448737.487786:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22752:x1875323826457344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 100us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448737.487793:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448737.487814:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6561500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22752:1875323826457344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448737.487875:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6561500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22752:1875323826457472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448737.487919:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448737.487936:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448737.487946:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826457472 00000100:00100000:3.0:1788448737.487950:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826457472 00000100:00100000:3.0:1788448737.487967:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788448737.487981:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22752:x1875323826457472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448737.488030:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22752:x1875323826457472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448737.488037:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448737.488065:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826456832:0@lo:38:kworker.0 00000100:00100000:3.0:1788448737.488066:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6561500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22752:1875323826457472:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788448737.488116:0:22752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788448737.497725:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826457216:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788448737.498782:0:22752:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788448737.499033:0:22752:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:3.0:1788448737.499039:0:22752:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788448737.727503:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788448738.461078:0:23816:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788448738.461277:0:23816:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788448738.750052:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788448739.455462:0:23866:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffff9ab290 20000000:00000080:3.0:1788448739.455480:0:23866:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc19e37f000 uarg=0000000000000000 20000000:01000000:3.0:1788448739.455525:0:23866:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788448739.455532:0:23866:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788448739.455538:0:23866:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788448739.459570:0:23867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788448739.460182:0:23866:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788448739.468341:0:23866:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788448739.468371:0:23866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448739.468388:0:23866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1e000/0xf45a9e4e6b805148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805141 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448739.468395:0:23866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b80524b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805244 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448739.468403:0:23866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448739.468456:0:23866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b80524b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b805244 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448739.468470:0:23866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b80524b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b805244 expref: 17 pid: 22705 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448739.468484:0:23866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6561500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23866:1875323826457600:0@lo:104: 00000100:00100000:3.0:1788448739.468543:0:23866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788448739.468712:0:23866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1e000/0xf45a9e4e6b805148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b805141 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448739.468720:0:23866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc182c1e000/0xf45a9e4e6b805148 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b805141 expref: 17 pid: 22704 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448739.468728:0:23866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23866:1875323826457728:0@lo:104: 00000100:00100000:3.0:1788448739.468750:0:23866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448739.469928:0:23866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788448739.472002:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826457600 00000100:00100000:2.0:1788448739.472014:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826457600 00000100:00100000:0.0:1788448739.472442:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826457728 00000100:00100000:0.0:1788448739.472447:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826457728 00000100:00100000:0.0:1788448739.472490:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448739.472500:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+4:23866:x1875323826457728:12345-0@lo:104: 00010000:00010000:0.0:1788448739.472518:0:22693:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448739.472641:0:22693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448739.472647:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+4:23866:x1875323826457728:12345-0@lo:104: Request processed in 149us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448739.472654:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448739.472784:0:23866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23866:1875323826457728:0@lo:104: 00010000:00010000:1.0:1788448739.472830:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448739.472837:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.472845:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448739.472849:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.472859:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448739.472866:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448739.472872:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788448739.472933:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.472946:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448739.472971:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.472978:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b805141 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805148 expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.472990:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448739.472992:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448739.472994:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448739.473001:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448739.473014:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826457856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448739.473050:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448739.473093:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826457856 00000100:00100000:1.0:1788448739.473098:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826457856 00010000:00010000:1.0:1788448739.473118:0:22695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1e000/0xf45a9e4e6b805148 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805141 expref: 18 pid: 22704 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448739.473138:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448739.473145:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:3648:x1875323826457856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448739.473154:0:22695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448739.473160:0:22695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1e000/0xf45a9e4e6b805148 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805141 expref: 18 pid: 22704 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.473168:0:22695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1e000/0xf45a9e4e6b805148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b805141 expref: 18 pid: 22704 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.473181:0:22695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1e000/0xf45a9e4e6b805148 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b805141 expref: 18 pid: 22704 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.473207:0:22695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448739.473235:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:3648:x1875323826457856:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448739.473241:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448739.473269:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826457856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448739.475008:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448739.475019:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6562680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:23866:x1875323826457600:12345-0@lo:104: 00010000:00010000:3.0:1788448739.475036:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448739.475109:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788448739.475116:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6562680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:23866:x1875323826457600:12345-0@lo:104: Request processed in 99us (6572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448739.475122:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448739.475236:0:23866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6561500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23866:1875323826457600:0@lo:104: 00010000:00010000:2.0:1788448739.475270:0:23866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475326:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448739.475332:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475339:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e4200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448739.475343:0:22698:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475351:0:22698:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448739.475358:0:22698:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448739.475363:0:22698:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788448739.475397:0:22698:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475404:0:22698:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448739.475428:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475435:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b805244 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80524b expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475464:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448739.475466:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448739.475467:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448739.475474:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448739.475485:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3647:1875323826457984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448739.475518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448739.475568:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826457984 00000100:00100000:1.0:1788448739.475572:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826457984 00010000:00010000:1.0:1788448739.475591:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b80524b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805244 expref: 17 pid: 22705 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448739.475610:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448739.475616:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:3647:x1875323826457984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448739.475626:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448739.475631:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b80524b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805244 expref: 17 pid: 22705 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475642:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b80524b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b805244 expref: 17 pid: 22705 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475654:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b80524b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b805244 expref: 17 pid: 22705 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475666:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475685:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475710:0:22696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475718:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475724:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475731:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475737:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448739.475746:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475754:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475765:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.475774:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448739.475801:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+16:3647:x1875323826457984:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448739.475808:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448739.475834:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3647:1875323826457984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448739.475961:0:23866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448739.475969:0:23866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448739.475985:0:23866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b80529f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448739.774899:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448740.798315:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788448741.250538:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788448741.381233:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788448741.381240:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc083f6a800 from 13 10000000:01000000:0.0:1788448741.381245:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788448741.381289:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448741.381301:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448741.381312:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448741.381336:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448741.381410:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448741.381445:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190c9a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788448741.381515:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826458112 00000100:00100000:3.0:1788448741.381530:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826458112 00000100:00100000:3.0:1788448741.381579:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788448741.381587:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+16:22707:x1875323826458112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448741.381599:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448741.381611:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8052ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8052a6 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448741.381633:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8052ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8052a6 expref: 17 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448741.381642:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8052ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8052a6 expref: 17 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448741.381651:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8e00, rc 0) 00000100:00100000:3.0:1788448741.381710:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:22707:x1875323826458112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448741.381726:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788448741.384611:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448741.384638:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448741.384651:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448741.384741:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448741.384812:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448741.384847:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18540fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448741.385258:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826458240 00000100:00100000:3.0:1788448741.385270:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826458240 00000100:00100000:3.0:1788448741.385317:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788448741.385327:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:22707:x1875323826458240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448741.385440:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:22707:x1875323826458240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448741.385447:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788448741.386303:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448741.386344:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448741.386401:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448741.386437:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18540fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448741.386700:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826458368 00000100:00100000:0.0:1788448741.386706:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826458368 00000100:00100000:0.0:1788448741.386812:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788448741.386820:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bc3a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:22707:x1875323826458368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448741.386938:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bc3a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:22707:x1875323826458368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448741.386945:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788448741.388814:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788448741.390296:0:23942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788448741.390614:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788448741.390651:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448741.390672:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448741.390685:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448741.390696:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788448741.390699:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1bfee5000 from 13 10000000:01000000:0.0:1788448741.390702:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788448741.390744:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448741.390753:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448741.390764:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448741.390790:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448741.390849:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448741.390900:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826458496 00000100:00100000:0.0:1788448741.390906:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826458496 00000100:00100000:0.0:1788448741.390942:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788448741.390951:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bc3a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+17:22707:x1875323826458496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448741.390962:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448741.390973:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b8052bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8052b4 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448741.390996:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b8052bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8052b4 expref: 18 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448741.391012:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b8052bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8052b4 expref: 18 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448741.391021:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f000, rc 0) 00000100:00100000:0.0:1788448741.391050:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bc3a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:22707:x1875323826458496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448741.391057:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788448741.391098:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190c9ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448741.391127:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448741.391140:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448741.391149:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448741.391196:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448741.391219:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448741.391239:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826458624 00000100:00100000:0.0:1788448741.391242:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826458624 00000100:00100000:0.0:1788448741.391263:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788448741.391269:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bc3a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:22707:x1875323826458624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448741.391357:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bc3a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:22707:x1875323826458624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448741.391363:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788448741.391384:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190c9ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448741.391394:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448741.391426:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448741.391461:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448741.391479:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826458752 00000100:00100000:0.0:1788448741.391483:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826458752 00000100:00100000:0.0:1788448741.391504:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788448741.391510:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bc3a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:22707:x1875323826458752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448741.391574:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bc3a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:22707:x1875323826458752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448741.391581:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788448741.391609:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190c9ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448741.391620:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826458752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788448741.397519:0:23943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788448741.397747:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788448741.397772:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448741.397782:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448741.397794:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448741.822962:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788448742.590413:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448742.590421:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448742.590424:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448742.590428:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448742.590454:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448742.590468:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448742.590654:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448742.590666:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788448742.590749:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826458880:0@lo:400:kworker.0 00000100:00100000:0.0:1788448742.590829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448742.590872:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826459392:0@lo:400:kworker.0 00000100:00100000:0.0:1788448742.590929:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448742.590956:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788448742.590962:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826459008:0@lo:400:kworker.0 00000100:00100000:0.0:1788448742.591032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448742.591051:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826459520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448742.591069:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448742.591096:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826459264:0@lo:400:kworker.0 00000100:00100000:0.0:1788448742.591119:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448742.591136:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448742.591140:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826459136:0@lo:400:kworker.0 00000100:00100000:0.0:1788448742.591160:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448742.591222:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826458880 00000100:00100000:0.0:1788448742.591231:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826458880 00000100:00100000:0.0:1788448742.591291:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788448742.591301:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bc3a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:3645:x1875323826458880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448742.591351:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bc3a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:3645:x1875323826458880:12345-0@lo:400:kworker.0 Request processed in 52us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448742.591787:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826459008 00000100:00100000:1.0:1788448742.591793:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826459008 00000100:00100000:1.0:1788448742.591820:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826459520 00000100:00100000:1.0:1788448742.591823:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826459520 00000100:00100000:1.0:1788448742.591833:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826459264 00000100:00100000:1.0:1788448742.591836:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826459264 00000100:00100000:1.0:1788448742.591847:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448742.591854:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1875323826459008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448742.591916:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1875323826459008:12345-0@lo:400:kworker.0 Request processed in 61us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448742.591924:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448742.591949:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448742.591954:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826459520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448742.591976:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788448742.592005:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826459520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448742.592009:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448742.592019:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448742.592024:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826459264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448742.592051:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826459264:12345-0@lo:400:kworker.0 Request processed in 28us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448742.592057:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448742.592086:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826459264:0@lo:400:kworker.0 00000100:00100000:3.0:1788448742.592348:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826459648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448742.592397:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448742.592443:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826459648 00000100:00100000:3.0:1788448742.592447:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826459648 00000100:00100000:3.0:1788448742.592467:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448742.592483:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826459648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448742.592500:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788448742.592766:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788448742.592818:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826459392 00000100:00100000:0.0:1788448742.592823:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826459392 00000100:00100000:0.0:1788448742.592847:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826459136 00000100:00100000:0.0:1788448742.592850:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826459136 00000100:00100000:0.0:1788448742.592865:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448742.592871:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826459392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448742.592921:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826459392:12345-0@lo:400:kworker.0 Request processed in 50us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448742.592927:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448742.592939:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448742.592944:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826459136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448742.592990:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826459136:12345-0@lo:400:kworker.0 Request processed in 46us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448742.592997:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448742.593043:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826459008:0@lo:400:kworker.0 00000100:00100000:0.0:1788448742.593056:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826459520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448742.593065:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826458880:0@lo:400:kworker.0 00010000:00080000:0.0:1788448742.593077:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc1bff08000 x1875323826459392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448742.593088:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826459392:0@lo:400:kworker.0 00000100:00100000:3.0:1788448742.593195:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826459648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 721us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448742.593202:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788448742.593245:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc1bff0ad80 x1875323826459136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448742.593255:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826459136:0@lo:400:kworker.0 00000100:00100000:3.0:1788448742.593278:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826459648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448742.594953:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448732/real 1788448732] req@ffff9fc083e4d180 x1875323826452992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448742 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448742.594977:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc083e4d180 x1875323826452992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448742 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448742.594987:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448732/real 1788448732] req@ffff9fc1ba34ce00 x1875323826452864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448742 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448742.594998:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc1ba34ce00 x1875323826452864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448742 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448742.595015:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc188773000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448742.595034:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788448742.595037:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826452992:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788448742.595042:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448742.595058:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788448742.595061:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826452864:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788448742.595306:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448742.595312:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448742.595314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448742.595317:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448742.595320:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448742.595323:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788448742.595326:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448742.595331:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 649 00000100:00080000:1.0:1788448742.595335:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788448742.595342:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc1bb74f000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448742.595454:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083e4ea00 x1875323826459776/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448742.595618:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448742.595622:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788448742.595624:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc188773000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448742.595628:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 649 00000100:00080000:1.0:1788448742.595630:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788448742.595634:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc188773000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448742.595650:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083e4d180 x1875323826459904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788448742.600670:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826459776:0@lo:8:kworker.0 00000400:00000100:2.0:1788448742.600732:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826459776 offset 0 length 520: 4 00000100:00100000:2.0:1788448742.600773:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826459904:0@lo:8:kworker.0 00000400:00000100:2.0:1788448742.600793:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826459904 offset 0 length 520: 4 00010000:00010000:0.0:1788448742.846754:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788448743.619597:0:23445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788448743.870433:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448744.641964:0:23467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788448744.642053:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448729/real 1788448729] req@ffff9fc083e4c380 x1875323826450816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448744 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448744.642076:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc083e4c380 x1875323826450816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448744 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448744.642087:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448729/real 1788448729] req@ffff9fc083e4fb80 x1875323826450944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448744 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448744.642098:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc083e4fb80 x1875323826450944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448744 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788448744.642114:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc083f69800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448744.642131:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788448744.642135:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826450816:0@lo:8:kworker.0 00000100:00080000:2.0:1788448744.642140:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc182d6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448744.642145:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788448744.642148:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826450944:0@lo:8:kworker.0 00000100:00080000:2.0:1788448744.642343:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448744.642347:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788448744.642349:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc083f69800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788448744.642354:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:2.0:1788448744.642358:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788448744.642364:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc083f69800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448744.642381:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1ba34e680 x1875323826460288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788448744.642392:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448744.642395:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788448744.642397:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc182d6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788448744.642400:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:2.0:1788448744.642402:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788448744.642405:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc182d6f000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448744.642415:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1ba34dc00 x1875323826460416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788448744.642432:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448744.642434:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448744.642437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448744.642440:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788448744.642463:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826460032:0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.642519:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448744.642567:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826460800:0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.642603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448744.642625:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448744.642630:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826460672:0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.642665:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448744.642694:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826460160:0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.642719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448744.642737:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448744.642743:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826460544:0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.642767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448744.644686:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826460288:0@lo:8:kworker.0 00000400:00000100:2.0:1788448744.644731:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826460288 offset 0 length 520: 4 00000100:00100000:2.0:1788448744.644756:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826460416:0@lo:8:kworker.0 00000400:00000100:2.0:1788448744.645129:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826460416 offset 0 length 520: 4 00000100:00100000:2.0:1788448744.645166:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826460032 00000100:00100000:2.0:1788448744.645173:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826460032 00000100:00100000:2.0:1788448744.645222:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788448744.645231:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:3648:x1875323826460032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.645282:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:3648:x1875323826460032:12345-0@lo:400:kworker.0 Request processed in 53us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448744.645289:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788448744.645323:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826460800 00000100:00100000:2.0:1788448744.645327:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826460800 00000100:00100000:2.0:1788448744.645351:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826460544 00000100:00100000:2.0:1788448744.645355:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826460544 00000100:00100000:2.0:1788448744.645368:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788448744.645374:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826460800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.645414:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826460800:12345-0@lo:400:kworker.0 Request processed in 40us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448744.645421:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788448744.645435:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788448744.645441:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826460544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.645471:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826460544:12345-0@lo:400:kworker.0 Request processed in 31us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448744.645477:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788448744.645495:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826460672 00000100:00100000:2.0:1788448744.645499:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826460672 00000100:00100000:2.0:1788448744.646605:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826460160 00000100:00100000:2.0:1788448744.646615:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826460160 00000100:00100000:2.0:1788448744.646655:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788448744.646663:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826460672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.646709:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826460672:12345-0@lo:400:kworker.0 Request processed in 48us (4043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448744.646717:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788448744.646733:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788448744.646740:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826460160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.647608:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826460160:12345-0@lo:400:kworker.0 Request processed in 30us (4050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448744.647621:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788448744.647695:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826460672:0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.647707:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826460032:0@lo:400:kworker.0 00010000:00080000:2.0:1788448744.647722:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc1ba34d880 x1875323826460800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448744.647739:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826460800:0@lo:400:kworker.0 00010000:00080000:2.0:1788448744.648898:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc1ba34f100 x1875323826460544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448744.648912:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826460544:0@lo:400:kworker.0 00000100:00100000:2.0:1788448744.648931:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826460160:0@lo:400:kworker.0 00010000:00010000:0.0:1788448744.894228:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448745.920821:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788448746.597777:0:24214:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788448746.597781:0:24214:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788448746.597783:0:24214:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788448746.598322:0:24214:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc1a517b800 00000020:01000004:3.0:1788448746.598584:0:24214:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788448746.598597:0:24214:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788448746.598610:0:24214:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fc083f13370) 00000020:00000080:3.0:1788448746.598625:0:24214:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788448746.664753:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788448746.665283:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788448746.666014:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788448746.666776:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788448746.667021:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788448746.667214:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788448746.667610:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1788448746.670973:0:24214:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788448746.671175:0:24214:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788448746.671187:0:24214:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788448746.671199:0:24214:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45a9e4e6b8052c9 00000020:01000004:1.0:1788448746.671206:0:24214:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788448746.671227:0:24214:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788448746.671230:0:24214:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788448746.671236:0:24214:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788448746.671249:0:24214:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788448746.671259:0:24214:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fc1b5d58000) 00000020:00000080:1.0:1788448746.671271:0:24214:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788448746.674049:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448746.674220:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788448746.674226:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788448746.677443:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788448746.677457:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788448746.681171:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788448746.681186:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788448746.685544:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448746.685764:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788448746.685771:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788448746.690531:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788448746.690544:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788448746.729003:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448746.729789:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788448746.729796:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788448746.735914:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788448746.735929:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788448746.736742:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788448746.736750:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788448746.739344:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448746.739541:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788448746.739547:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788448746.740673:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788448746.740683:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788448746.804899:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448746.805112:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788448746.805119:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788448746.806698:0:24214:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788448746.806709:0:24214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788448746.807192:0:24214:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788448746.807217:0:24214:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788448746.807224:0:24214:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788448746.826591:0:24214:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788448746.826643:0:24214:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.121@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788448746.826648:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788448746.826655:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788448746.826656:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448746.826658:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448746.826659:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448746.826660:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448746.826661:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448746.826663:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448746.826664:0:24214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788448746.826668:0:24214:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788448746.826670:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788448746.826671:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788448746.826672:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448746.826673:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448746.826674:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448746.826674:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448746.826676:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448746.826677:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448746.826678:0:24214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788448746.826704:0:24214:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788448746.826724:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826460928:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788448746.826802:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448746.826952:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08364bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448746.827873:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826460928 00000100:00100000:2.0:1788448746.827979:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826460928 00000100:00100000:3.0:1788448746.828193:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788448746.828213:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:24214:x1875323826460928:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788448746.828321:0:22704:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788448746.828325:0:22704:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788448746.828345:0:22704:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788448746.829564:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:24214:x1875323826460928:12345-0@lo:253:mount.lustre.0 Request processed in 1354us (2754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448746.829578:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788448746.830841:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826460928:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788448746.830864:0:24214:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788448746.830868:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788448746.830870:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788448746.830871:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448746.830872:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448746.830874:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448746.830875:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448746.830877:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788448746.830980:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448746.830982:0:24214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788448746.831006:0:24214:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc1a517b800 from lustre-OST0000 10000000:01000000:1.0:1788448746.831058:0:24214:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788448746.831062:0:24214:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788448746.831070:0:24214:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc1bb53cd28 local copy 00010000:00010000:1.0:1788448746.831080:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448746.831187:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448746.831239:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448746.831321:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb4350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448746.831630:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826461056 00000100:00100000:3.0:1788448746.831649:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826461056 00000100:00100000:3.0:1788448746.831697:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788448746.831706:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:24214:x1875323826461056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448746.831817:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:24214:x1875323826461056:12345-0@lo:501:mount.lustre.0 Request processed in 111us (577us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788448746.831825:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448746.832013:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461056:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788448746.832028:0:24214:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788448746.832048:0:24214:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788448746.832056:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.832066:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448746.832093:0:24214:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc1a517b800 10000000:01000000:1.0:1788448746.832097:0:24214:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788448746.832102:0:24214:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788448746.832105:0:24214:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788448746.832109:0:24214:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788448746.832112:0:24214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788448746.832135:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b8052d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.832143:0:24214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b8052d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.832151:0:24214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b8052d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448746.832178:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788448746.832209:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448746.832241:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb4350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448746.835872:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826461184 00000100:00100000:3.0:1788448746.835924:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826461184 00000100:00100000:3.0:1788448746.835982:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788448746.835992:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+18:24214:x1875323826461184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448746.836008:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448746.836027:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8c00/0xf45a9e4e6b8052de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8052d7 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.836053:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8c00/0xf45a9e4e6b8052de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8052d7 expref: 19 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.836065:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8c00/0xf45a9e4e6b8052de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8052d7 expref: 19 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.836074:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8c00, rc 0) 00000100:00100000:3.0:1788448746.836142:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:24214:x1875323826461184:12345-0@lo:101:mount.lustre.0 Request processed in 151us (3932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448746.836148:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788448746.836324:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448746.836358:0:24214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b8052d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052de expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.836369:0:24214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b8052d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8052de expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448746.837658:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788448746.838565:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448746.844716:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788448746.844785:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788448746.844804:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788448746.844817:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788448746.844829:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788448746.844846:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788448746.844896:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788448746.844918:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788448746.844930:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788448746.844943:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788448746.844957:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788448746.844972:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788448746.844998:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788448746.845004:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788448746.846217:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448746.846282:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448746.846403:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb435f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448746.846749:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826461312 00000100:00100000:3.0:1788448746.846758:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826461312 00000100:00100000:3.0:1788448746.846842:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788448746.846852:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:24214:x1875323826461312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448746.847027:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:24214:x1875323826461312:12345-0@lo:501:mount.lustre.0 Request processed in 176us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448746.847046:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788448746.847127:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448746.847158:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448746.847195:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448746.847612:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb435f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448746.847722:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826461440 00000100:00100000:0.0:1788448746.847729:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826461440 00000100:00100000:0.0:1788448746.847757:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788448746.847765:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:24214:x1875323826461440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448746.848620:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:24214:x1875323826461440:12345-0@lo:503:mount.lustre.0 Request processed in 851us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448746.848643:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788448746.848832:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461440:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788448746.849300:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448746.849648:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448746.849710:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448746.849743:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb4350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448746.849823:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826461568 00000100:00100000:0.0:1788448746.849830:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826461568 00000100:00100000:0.0:1788448746.849878:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788448746.849908:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:24214:x1875323826461568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448746.850276:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:24214:x1875323826461568:12345-0@lo:502:mount.lustre.0 Request processed in 368us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448746.850290:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788448746.850629:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448746.850835:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788448746.850872:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788448746.850917:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788448746.850936:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788448746.850950:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788448746.850964:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788448746.850977:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788448746.851013:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788448746.851031:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788448746.851043:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788448746.851058:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788448746.851073:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788448746.851099:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448746.851143:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448746.851175:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb4350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448746.853570:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826461696 00000100:00100000:0.0:1788448746.853585:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826461696 00000100:00100000:0.0:1788448746.853664:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788448746.853675:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:24214:x1875323826461696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448746.853834:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:24214:x1875323826461696:12345-0@lo:502:mount.lustre.0 Request processed in 161us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448746.853842:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788448746.854007:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448746.854095:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788448746.854120:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788448746.858662:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788448746.858672:0:24231:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788448746.858679:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448746.858681:0:24231:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788448746.858688:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788448746.858705:0:24231:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fc1b5d5b370) 00000020:00000080:1.0:1788448746.858728:0:24231:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788448746.858734:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788448746.858798:0:24231:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1a517b800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788448746.858806:0:24231:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788448746.858812:0:24231:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45a9e4e6b8052ec 00010000:00010000:1.0:1788448746.866018:0:24231:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788448746.866595:0:24231:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1788448746.870144:0:24231:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788448746.873603:0:24231:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788448746.873618:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448746.873625:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448746.873627:0:24231:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788448746.873631:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788448746.873643:0:24231:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788448746.873645:0:24231:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788448746.873647:0:24231:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788448746.873648:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788448746.873651:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448746.873652:0:24231:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788448746.873655:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448746.873657:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448746.873658:0:24231:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788448746.873661:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788448746.873663:0:24231:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788448746.873665:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448746.873667:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448746.873668:0:24231:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788448746.873670:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448746.873672:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448746.873673:0:24231:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788448746.873676:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788448746.873717:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448746.873720:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448746.873722:0:24231:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788448746.873725:0:24231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788448746.882748:0:24214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788448746.882804:0:24214:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788448746.882823:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b8052d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052de expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.882837:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b8052d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052de expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448746.882846:0:24214:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1a517b800 from 1 10000000:01000000:3.0:1788448746.882849:0:24214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448746.882909:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.882917:0:24214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.882928:0:24214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448746.882953:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6562d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788448746.883018:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448746.883052:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08254d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448746.883318:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826461824 00000100:00100000:0.0:1788448746.883327:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826461824 00000100:00100000:0.0:1788448746.883397:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788448746.883407:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:24214:x1875323826461824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448746.883421:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448746.883435:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1f800/0xf45a9e4e6b8052fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8052f3 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448746.883458:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1f800/0xf45a9e4e6b8052fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8052f3 expref: 20 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448746.883468:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1f800/0xf45a9e4e6b8052fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8052f3 expref: 20 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448746.883477:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f800, rc 0) 00000100:00100000:2.0:1788448746.883729:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6562d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448746.883745:0:24214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.883754:0:24214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448746.884226:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:24214:x1875323826461824:12345-0@lo:101:mount.lustre.0 Request processed in 819us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448746.884234:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000040:00080000:2.0:1788448746.885199:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788448746.888778:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448746.889055:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788448746.889081:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788448746.889113:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788448746.889130:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788448746.889144:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788448746.889156:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788448746.889171:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788448746.889184:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788448746.889197:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788448746.889211:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788448746.889224:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788448746.889242:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788448746.889248:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788448746.889336:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448746.889409:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.889463:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788448746.889660:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826461952 00000100:00100000:1.0:1788448746.889670:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826461952 00000100:00100000:1.0:1788448746.889724:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788448746.889735:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:24214:x1875323826461952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448746.889868:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:24214:x1875323826461952:12345-0@lo:501:mount.lustre.0 Request processed in 134us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448746.889903:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788448746.894585:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826461952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448746.894654:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448746.894729:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.894769:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788448746.895033:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826462080 00000100:00100000:1.0:1788448746.895040:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826462080 00000100:00100000:1.0:1788448746.895090:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788448746.895100:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:24214:x1875323826462080:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448746.895213:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:24214:x1875323826462080:12345-0@lo:503:mount.lustre.0 Request processed in 113us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448746.895229:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788448746.895308:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462080:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788448746.898104:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448746.898192:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448746.898268:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.898312:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448746.898490:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826462208 00000100:00100000:3.0:1788448746.898497:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826462208 00000100:00100000:3.0:1788448746.898543:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788448746.898553:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:24214:x1875323826462208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448746.898665:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:24214:x1875323826462208:12345-0@lo:502:mount.lustre.0 Request processed in 113us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448746.898678:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788448746.900699:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448746.900979:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788448746.901022:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788448746.901037:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788448746.901050:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788448746.901083:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788448746.901098:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788448746.901116:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788448746.901129:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788448746.901142:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788448746.901154:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788448746.901166:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788448746.901200:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448746.901261:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.901302:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448746.901487:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826462336 00000100:00100000:1.0:1788448746.901496:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826462336 00000100:00100000:1.0:1788448746.901536:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788448746.901545:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:24214:x1875323826462336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448746.901670:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:24214:x1875323826462336:12345-0@lo:502:mount.lustre.0 Request processed in 125us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448746.901677:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788448746.906074:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448746.906166:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788448746.906179:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788448746.907685:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448746.907696:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448746.907698:0:24235:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788448746.907705:0:24235:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc1a517b800 00000020:00000080:3.0:1788448746.907708:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448746.907715:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448746.907718:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448746.907719:0:24235:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788448746.907721:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448746.907724:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448746.907725:0:24235:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788448746.907728:0:24235:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc1a517b800 00000020:00000080:3.0:1788448746.907730:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448746.907791:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448746.907795:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448746.907796:0:24235:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788448746.907798:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448746.907801:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448746.907802:0:24235:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788448746.907805:0:24235:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc1a517b800 00000020:00000080:3.0:1788448746.907807:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448746.907826:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448746.907828:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448746.907830:0:24235:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788448746.907832:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448746.907834:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448746.907835:0:24235:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788448746.907837:0:24235:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc1a517b800 00000020:00000080:3.0:1788448746.907840:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448746.907859:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448746.907862:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448746.907876:0:24235:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788448746.907909:0:24235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788448746.917167:0:24214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788448746.917215:0:24214:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448746.917240:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.917253:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448746.917308:0:24214:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788448746.917311:0:24214:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc1a517b800 10000000:01000000:2.0:1788448746.917314:0:24214:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc1a517b800 10000000:01000000:2.0:1788448746.917317:0:24214:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448746.917322:0:24214:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc1a517b800 from 1 10000000:01000000:2.0:1788448746.917324:0:24214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788448746.917376:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5c00/0xf45a9e4e6b805301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.917384:0:24214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5c00/0xf45a9e4e6b805301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.917395:0:24214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5c00/0xf45a9e4e6b805301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448746.917419:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448746.917481:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.917539:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448746.919583:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826462464 00000100:00100000:0.0:1788448746.919597:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826462464 00000100:00100000:0.0:1788448746.919670:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788448746.919680:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:24214:x1875323826462464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448746.919696:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448746.919715:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805301 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448746.919761:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805301 expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448746.919772:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1ea00/0xf45a9e4e6b805308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805301 expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448746.919782:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1ea00, rc 0) 00000100:00100000:0.0:1788448746.919855:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826462464:12345-0@lo:101:mount.lustre.0 Request processed in 177us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448746.919862:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788448746.920090:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448746.920111:0:24214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5c00/0xf45a9e4e6b805301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805308 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.920122:0:24214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5c00/0xf45a9e4e6b805301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805308 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448746.921566:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788448746.921868:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448746.922073:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788448746.922099:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788448746.922115:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788448746.922129:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788448746.922142:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788448746.922154:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788448746.922166:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788448746.922179:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788448746.922193:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788448746.922221:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788448746.922236:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788448746.922251:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788448746.922265:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788448746.922278:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788448746.922289:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788448746.922312:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788448746.922324:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788448746.927447:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788448746.927499:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788448746.927752:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788448746.927773:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788448746.927788:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788448746.927802:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788448746.927818:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788448746.927835:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788448746.927849:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788448746.927865:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788448746.927899:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788448746.927919:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788448746.927936:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788448746.927953:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788448746.927990:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788448746.928008:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788448746.928022:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788448746.928036:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788448746.928049:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788448746.928066:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788448746.928083:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788448746.928098:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788448746.928113:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788448746.928125:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788448746.928137:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788448746.928160:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788448746.928174:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788448746.928187:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788448746.928201:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788448746.928215:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788448746.928245:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788448746.930923:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788448746.930976:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788448746.931005:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788448746.931011:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788448746.931113:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448746.931172:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.931220:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788448746.931706:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826462592 00000100:00100000:3.0:1788448746.931716:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826462592 00000100:00100000:3.0:1788448746.931770:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788448746.931781:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826462592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448746.931942:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826462592:12345-0@lo:501:mount.lustre.0 Request processed in 163us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448746.931951:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788448746.933031:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448746.933084:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448746.933140:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.933183:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448746.933997:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826462720 00000100:00100000:0.0:1788448746.934006:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826462720 00000100:00100000:0.0:1788448746.934064:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788448746.934075:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826462720:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448746.934200:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826462720:12345-0@lo:503:mount.lustre.0 Request processed in 127us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448746.934209:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788448746.936960:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462720:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788448746.937412:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788448746.937625:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448746.938254:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448746.938303:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192125300 going to sleep for 11 seconds 00000100:00100000:3.0:1788448746.939332:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826462848 00000100:00100000:3.0:1788448746.939345:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826462848 00000100:00100000:3.0:1788448746.939446:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788448746.939455:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826462848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448746.939961:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826462848:12345-0@lo:502:mount.lustre.0 Request processed in 504us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448746.939971:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788448746.940004:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788448746.940683:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788448746.940718:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788448746.940743:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788448746.941460:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788448746.941482:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788448746.941496:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788448746.941577:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788448746.941598:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788448746.941614:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788448746.941629:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788448746.941656:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788448746.941669:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788448746.941684:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788448746.941697:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788448746.941709:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788448746.941723:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788448746.941736:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788448746.941750:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788448746.941763:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788448746.941776:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788448746.941791:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788448746.941824:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788448746.941840:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788448746.941852:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788448746.941863:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788448746.941876:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788448746.941910:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788448746.941924:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788448746.941936:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788448746.941948:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788448746.941960:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788448746.941974:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788448746.941987:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788448746.942001:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788448746.942014:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788448746.942040:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788448746.942056:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788448746.942083:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788448746.942099:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788448746.942112:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788448746.942123:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788448746.942135:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788448746.942148:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788448746.942161:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788448746.942174:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788448746.942188:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788448746.942202:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788448746.942214:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788448746.942265:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448746.944093:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448746.944130:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448746.944151:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192125300 going to sleep for 11 seconds 00000100:00100000:2.0:1788448746.944282:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826462976 00000100:00100000:2.0:1788448746.944291:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826462976 00000100:00100000:2.0:1788448746.944627:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788448746.944648:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826462976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448746.944811:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826462976:12345-0@lo:502:mount.lustre.0 Request processed in 166us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448746.944820:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788448746.944923:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826462976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448746.945179:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788448746.945207:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788448746.945243:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6562d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826463104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448746.945288:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448746.946670:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08254d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448746.946813:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826463104 00000100:00100000:0.0:1788448746.946821:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826463104 00000100:00100000:0.0:1788448746.946863:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788448746.946871:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826463104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448746.947073:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826463104:12345-0@lo:502:mount.lustre.0 Request processed in 202us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448746.947080:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788448746.947456:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6562d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826463104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448746.947534:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788448746.947546:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788448746.960219:0:24240:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788448746.960243:0:24240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fc0824299b8) 00000020:00000080:0.0:1788448746.960268:0:24240:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788448746.960352:0:24240:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1a517b800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788448746.960356:0:24240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1a517b800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788448746.960359:0:24240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1a517b800 3 00010000:00080000:0.0:1788448746.960394:0:24240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc08260a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448746.962839:0:24240:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788448746.963192:0:24240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788448746.963237:0:24240:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788448746.963250:0:24240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf45a9e4e6b805316 00000100:00080000:0.0:1788448746.963260:0:24240:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448746.963266:0:24240:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc08260a800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448746.963301:0:24240:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bb426d80 x1875323826463232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788448746.963372:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826463232:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788448746.963496:0:24240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788448746.963602:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.963678:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826463232 00000100:00100000:2.0:1788448746.963693:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826463232 00000100:00100000:2.0:1788448746.963722:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448746.963729:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826463232:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788448746.963760:0:22712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:2.0:1788448746.963790:0:22712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf45a9e4e6b80531d 00000004:00100000:2.0:1788448746.963803:0:22712:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788448746.963832:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9fc1bd793800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448746.963901:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875323826463232:12345-0@lo:38:llog_process_th.0 Request processed in 149us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448746.963909:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788448746.963955:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb426d80 x1875323826463232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448746.963965:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448746.963971:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788448746.963977:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788448746.963980:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788448746.963982:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc08260a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448746.963987:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826463232:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788448746.964132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448746.964136:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448746.964139:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448746.964141:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448746.964162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448746.964165:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448746.964172:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448746.964175:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788448746.964205:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826463488:0@lo:400:kworker.0 00000100:00100000:2.0:1788448746.964234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.964254:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448746.964260:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826463360:0@lo:400:kworker.0 00000100:00100000:2.0:1788448746.964285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.964312:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826463616:0@lo:400:kworker.0 00000100:00100000:2.0:1788448746.964334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.964358:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448746.964369:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826463744:0@lo:400:kworker.0 00000100:00100000:2.0:1788448746.964392:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.964423:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826463488 00000100:00100000:2.0:1788448746.964427:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826463488 00000100:00100000:2.0:1788448746.964452:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826463744 00000100:00100000:2.0:1788448746.964455:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826463744 00000100:00100000:2.0:1788448746.964469:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448746.964476:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826463488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448746.964590:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826463488:12345-0@lo:400:kworker.0 Request processed in 114us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448746.964597:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448746.964611:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448746.964617:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826463744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448746.964660:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826463744:12345-0@lo:400:kworker.0 Request processed in 43us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448746.964674:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448746.964695:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826463360 00000100:00100000:2.0:1788448746.964699:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826463360 00000100:00100000:2.0:1788448746.964719:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826463616 00000100:00100000:2.0:1788448746.964721:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826463616 00000100:00100000:2.0:1788448746.964732:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448746.964738:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826463360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448746.964771:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826463360:12345-0@lo:400:kworker.0 Request processed in 33us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448746.964776:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448746.964787:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788448746.964793:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826463616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448746.964815:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826463616:12345-0@lo:400:kworker.0 Request processed in 23us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448746.964820:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788448746.964858:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1ba34d180 x1875323826463744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448746.964868:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826463744:0@lo:400:kworker.0 00000100:00100000:2.0:1788448746.964877:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826463616:0@lo:400:kworker.0 00000100:00100000:2.0:1788448746.964942:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826463360:0@lo:400:kworker.0 00010000:00080000:2.0:1788448746.964951:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1ba34fb80 x1875323826463488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448746.964959:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826463488:0@lo:400:kworker.0 00000020:01000004:3.0:1788448746.969665:0:24240:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788448746.969692:0:24240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9fc1bb79cd28) 00000020:00000080:3.0:1788448746.969716:0:24240:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788448746.969804:0:24240:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1a517b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788448746.969809:0:24240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1a517b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788448746.969811:0:24240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1a517b800 3 00010000:00080000:3.0:1788448746.969852:0:24240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc1bb74b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.121@tcp at head 00010000:00010000:3.0:1788448746.971462:0:24240:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788448746.971653:0:24240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788448746.971691:0:24240:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788448746.971703:0:24240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf45a9e4e6b80532b 00000100:00080000:3.0:1788448746.971713:0:24240:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788448746.971718:0:24240:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9fc1bb74b000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448746.971750:0:24240:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1b6562d80 x1875323826463872/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448746.971781:0:24240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788448746.971812:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448746.971817:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448746.971819:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448746.971822:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448746.971825:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448746.971828:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448746.971830:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448746.971833:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788448746.971841:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875323826463872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448746.971930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.971984:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826463872 00000100:00100000:2.0:1788448746.971991:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826463872 00000100:00100000:2.0:1788448746.972024:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448746.972031:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875323826463872:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788448746.972054:0:22711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:2.0:1788448746.972084:0:22711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf45a9e4e6b805332 00000004:00100000:2.0:1788448746.972097:0:22711:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788448746.972125:0:22711:0:(import.c:65:import_set_state_nolock()) ffff9fc1bd791800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448746.972171:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875323826463872:12345-0@lo:38:llog_process_th.0 Request processed in 139us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448746.972178:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788448746.972218:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b6562d80 x1875323826463872/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448746.972228:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448746.972234:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788448746.972240:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788448746.972243:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788448746.972246:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448746.972250:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875323826463872:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788448746.974285:0:24240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788448746.974909:0:24214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788448746.974944:0:24214:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788448746.974962:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5c00/0xf45a9e4e6b805301 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805308 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.974973:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5c00/0xf45a9e4e6b805301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805308 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788448746.975025:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788448746.975027:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788448746.975028:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448746.975030:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448746.975031:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448746.975032:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448746.975034:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448746.975035:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448746.975037:0:24214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448746.975041:0:24214:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788448746.975043:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448746.975045:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788448746.975046:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448746.975047:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448746.975048:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448746.975049:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448746.975050:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448746.975051:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448746.975052:0:24214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448746.975574:0:24214:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788448746.975592:0:24214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826464000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788448746.975660:0:24214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448746.976170:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826464000 00000100:00100000:0.0:1788448746.976178:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826464000 00000100:00100000:0.0:1788448746.976217:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788448746.976225:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826464000:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788448746.976247:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788448746.976258:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788448746.977214:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:2.0:1788448746.977231:0:24214:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3cc0 going to sleep for 11 seconds 20000000:01000000:0.0:1788448746.977290:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788448746.977484:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:24214:x1875323826464000:12345-0@lo:253:mount.lustre.0 Request processed in 1257us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448746.977493:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788448746.977812:0:24214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:24214:1875323826464000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788448746.977824:0:24214:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788448746.977827:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788448746.977829:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788448746.977830:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448746.977831:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448746.977832:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448746.977833:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448746.977841:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448746.977843:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448746.977845:0:24214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788448746.977858:0:24214:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788448746.978014:0:22726:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788448746.978019:0:22726:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788448746.978035:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.978049:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80527c expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.978057:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b805291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80528a expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.978072:0:22726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.978098:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b805291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80528a expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.978137:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b805291 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80528a expref: 20 pid: 22704 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448746.978150:0:22726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff48380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826464128:0@lo:104: 00000100:00100000:2.0:1788448746.978182:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448746.978223:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80527c expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.978231:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805283 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80527c expref: 20 pid: 22704 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448746.978239:0:22726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff4ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826464256:0@lo:104: 00000100:00100000:2.0:1788448746.978258:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448746.978270:0:22726:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788448746.978325:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788448746.978339:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826464128 00000100:00100000:1.0:1788448746.978343:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826464128 00000100:00100000:1.0:1788448746.978364:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826464256 00000100:00100000:1.0:1788448746.978367:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826464256 00000100:00100000:1.0:1788448746.978377:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448746.978384:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+4:22726:x1875323826464128:12345-0@lo:104: 00010000:00010000:1.0:1788448746.978394:0:22693:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.978442:0:22693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448746.978447:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+4:22726:x1875323826464128:12345-0@lo:104: Request processed in 65us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448746.978454:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448746.978468:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448746.978474:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:22726:x1875323826464256:12345-0@lo:104: 00010000:00010000:1.0:1788448746.978482:0:22693:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448746.979170:0:22726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff48380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826464128:0@lo:104: 00010000:00010000:1.0:1788448746.979264:0:22693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788448746.979271:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:22726:x1875323826464256:12345-0@lo:104: Request processed in 797us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448746.979277:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788448746.979317:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788448746.979323:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.979330:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e5400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448746.979335:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.979344:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448746.979350:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448746.979355:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448746.979386:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.979393:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448746.979412:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.979419:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5400/0xf45a9e4e6b80528a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805291 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.979441:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448746.979444:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.979449:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e5000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448746.979452:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.979459:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448746.979465:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448746.979470:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448746.979484:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.979490:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448746.979496:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.979501:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5000/0xf45a9e4e6b80527c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805283 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448746.980461:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448746.980911:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448746.980913:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448746.980915:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448746.980930:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826464384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448746.980988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448746.981034:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448746.981041:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826464512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448746.981062:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826464384 00000100:00100000:1.0:1788448746.981065:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448746.981072:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826464384 00000100:00100000:1.0:1788448746.981093:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826464512 00000100:00100000:1.0:1788448746.981096:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826464512 00010000:00010000:3.0:1788448746.981098:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b805291 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80528a expref: 21 pid: 22704 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.981107:0:22695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805283 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80527c expref: 22 pid: 22704 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448746.981121:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448746.981135:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:3645:x1875323826464384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448746.981146:0:22695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448746.981151:0:22695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b805291 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80528a expref: 22 pid: 22704 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.981162:0:22695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b805291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80528a expref: 22 pid: 22704 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.981176:0:22695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b805291 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80528a expref: 22 pid: 22704 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448746.981189:0:22695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448746.981221:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:3645:x1875323826464384:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448746.981549:0:22726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff4ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826464256:0@lo:104: 00010000:00010000:2.0:1788448746.981570:0:22726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788448746.982434:0:24214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788448746.984483:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788448746.984500:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1aebe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:3645:x1875323826464512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448746.984522:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448746.984531:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805283 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80527c expref: 21 pid: 22704 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.984546:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80527c expref: 21 pid: 22704 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.984562:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805283 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80527c expref: 21 pid: 22704 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.984577:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.984585:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788448746.984602:0:22696:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006583163s 00010000:00010000:3.0:1788448746.984606:0:22696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.984612:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.984618:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.984647:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.984653:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e4200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448746.984657:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.984664:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.984691:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448746.984702:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448746.984762:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1aebe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:3645:x1875323826464512:12345-0@lo:103:ldlm_bl.0 Request processed in 268us (3695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448746.984769:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:0.0:1788448746.986246:0:24214:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788448746.986254:0:24214:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788448746.986286:0:24214:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788448746.986323:0:24214:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788448746.986341:0:24214:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788448746.986361:0:24214:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788448746.987134:0:24214:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448746.987344:0:24214:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788448746.988441:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448746.988553:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826464512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448746.988564:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826464384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448746.988690:0:22726:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.988714:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448746.988721:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b805339 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448747.710108:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826464640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448747.710185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448747.710267:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826464640 00000100:00100000:2.0:1788448747.710275:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826464640 00000100:00100000:2.0:1788448747.710323:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788448747.710348:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826464640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788448747.710384:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788448747.711808:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826464640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1455us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448747.711820:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788448747.711864:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826464768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448747.716864:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826464640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448747.718040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448747.727377:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826464768 00000100:00100000:3.0:1788448747.727393:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826464768 00000100:00100000:3.0:1788448747.727456:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448747.727467:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826464768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448747.727501:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788448747.727577:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826464768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (10249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448747.727584:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788448747.727716:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826464768:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1788448747.885344:0:24293:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788448747.885560:0:24293:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788448747.984361:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788448748.863452:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788448748.863461:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc083f6a800 from 13 10000000:01000000:0.0:1788448748.863467:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788448748.863513:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448748.863525:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448748.863537:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448748.863563:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826464896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448748.863645:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448748.863689:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d23780 going to sleep for 11 seconds 00000100:00100000:3.0:1788448748.863775:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826464896 00000100:00100000:3.0:1788448748.863783:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826464896 00000100:00100000:3.0:1788448748.863841:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788448748.863863:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+19:22707:x1875323826464896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448748.863877:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448748.863917:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b805347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805340 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448748.863942:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b805347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805340 expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448748.863953:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b805347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805340 expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448748.863962:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8000, rc 0) 00000100:00100000:3.0:1788448748.864010:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:22707:x1875323826464896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448748.864017:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788448748.864630:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826464896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448748.864649:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448748.864660:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448748.865006:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826465024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788448748.866391:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448748.866441:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0834b4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448748.866462:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826465024 00000100:00100000:3.0:1788448748.866476:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826465024 00000100:00100000:3.0:1788448748.866530:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788448748.866540:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:22707:x1875323826465024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788448748.866564:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788448748.866579:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788448748.866582:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788448748.866681:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:22707:x1875323826465024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448748.866689:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788448748.867493:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826465024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788448748.868405:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788448748.868419:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448748.868431:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448748.868769:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788448748.868773:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc1bfee5000 from 13 10000000:01000000:1.0:1788448748.868777:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788448748.868822:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448748.868843:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448748.868855:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448748.868878:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826465152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448748.868980:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448748.869015:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0834b4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448748.869313:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826465152 00000100:00100000:0.0:1788448748.869321:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826465152 00000100:00100000:0.0:1788448748.869387:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788448748.869397:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:22707:x1875323826465152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448748.869416:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448748.869429:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80534e expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448748.869453:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80534e expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448748.869463:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80534e expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448748.869472:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f600, rc 0) 00000100:00100000:0.0:1788448748.869525:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:22707:x1875323826465152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448748.869532:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788448748.869674:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826465152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448748.869689:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448748.869710:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448748.869764:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826465280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788448748.869796:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448748.869860:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1908606c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448748.869967:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826465280 00000100:00100000:0.0:1788448748.869972:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826465280 00000100:00100000:0.0:1788448748.870037:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788448748.870044:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:22707:x1875323826465280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788448748.870059:0:22704:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788448748.870075:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788448748.870078:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788448748.870153:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:22707:x1875323826465280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448748.870160:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788448748.870231:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826465280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788448748.870284:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788448748.870291:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448748.870305:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448748.990151:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448750.015020:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448751.038132:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448751.488793:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788448752.062224:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448752.328342:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826465408:0@lo:400:kworker.0 00000100:00100000:1.0:1788448752.328414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448752.334295:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448752.334318:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826465536:0@lo:400:kworker.0 00000100:00100000:1.0:1788448752.334392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448752.334463:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826465408 00000100:00100000:1.0:1788448752.334471:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826465408 00000100:00100000:1.0:1788448752.334534:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788448752.334544:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:3645:x1875323826465408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448752.334599:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:3645:x1875323826465408:12345-0@lo:400:kworker.0 Request processed in 56us (6185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448752.334618:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788448752.334675:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826465408:0@lo:400:kworker.0 00000100:00100000:0.0:1788448752.336178:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826465536 00000100:00100000:0.0:1788448752.336190:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826465536 00000100:00100000:0.0:1788448752.336240:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788448752.336251:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826465536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448752.336331:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826465536:12345-0@lo:400:kworker.0 Request processed in 82us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448752.336338:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448752.336751:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826465536:0@lo:400:kworker.0 00000100:00080000:2.0:1788448752.342638:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448752.342648:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448752.342651:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448752.342654:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448752.342704:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448752.342706:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448752.342715:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448752.342718:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788448752.342766:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826465664:0@lo:400:kworker.0 00000100:00100000:2.0:1788448752.342826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448752.342856:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826466176:0@lo:400:kworker.0 00000100:00100000:2.0:1788448752.342876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448752.342912:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448752.342918:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826465792:0@lo:400:kworker.0 00000100:00100000:2.0:1788448752.342941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448752.342966:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826466048:0@lo:400:kworker.0 00000100:00100000:2.0:1788448752.342988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448752.343002:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448752.343007:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826465920:0@lo:400:kworker.0 00000100:00100000:2.0:1788448752.343025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448752.343046:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826465664 00000100:00100000:2.0:1788448752.343052:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826465664 00000100:00100000:2.0:1788448752.343083:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826466176 00000100:00100000:2.0:1788448752.343086:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826466176 00000100:00100000:2.0:1788448752.343113:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826466048 00000100:00100000:2.0:1788448752.343116:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826466048 00000100:00080000:1.0:1788448752.343125:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448752.343126:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826465920 00000100:00100000:2.0:1788448752.343128:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826465920 00000100:00080000:1.0:1788448752.343133:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448752.343142:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448752.343150:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826465664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448752.343198:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826465664:12345-0@lo:400:kworker.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448752.343213:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448752.343230:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448752.343235:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826466176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448752.343263:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826466176:12345-0@lo:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448752.343269:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448752.343280:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448752.343285:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826466048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448752.343320:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826466048:12345-0@lo:400:kworker.0 Request processed in 35us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448752.343325:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448752.343337:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448752.343344:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826465920:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788448752.343379:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bff49c00 x1875323826466048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448752.343392:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826466048:0@lo:400:kworker.0 00000100:00100000:0.0:1788448752.346741:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826465792 00000100:00100000:0.0:1788448752.346755:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826465792 00000100:00100000:0.0:1788448752.346822:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788448752.346832:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826465792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448752.347348:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826465920:12345-0@lo:400:kworker.0 Request processed in 4001us (4318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448752.347359:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788448752.347427:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bff4b480 x1875323826465664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448752.347442:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826465664:0@lo:400:kworker.0 00010000:00080000:2.0:1788448752.347455:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bff4bb80 x1875323826466176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448752.347464:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826466176:0@lo:400:kworker.0 00010000:00080000:1.0:1788448752.347729:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bff4b100 x1875323826465920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448752.347740:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826465920:0@lo:400:kworker.0 00000100:00100000:0.0:1788448752.349994:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826465792:12345-0@lo:400:kworker.0 Request processed in 3155us (7043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448752.350007:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448752.350363:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826465792:0@lo:400:kworker.0 00000100:00100000:2.0:1788448752.830122:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826466304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448752.830193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448752.830454:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826466304 00000100:00100000:0.0:1788448752.830462:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826466304 00000100:00100000:0.0:1788448752.830516:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788448752.830526:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826466304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448752.830561:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788448752.830671:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826466304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448752.830689:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788448752.835019:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826466304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448752.839245:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826466432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448752.839334:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448752.839925:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826466432 00000100:00100000:3.0:1788448752.839934:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826466432 00000100:00100000:3.0:1788448752.839983:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788448752.839994:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826466432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448752.840025:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788448752.840710:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826466432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 716us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448752.840718:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788448752.840794:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826466432:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788448753.046081:0:24581:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788448753.086380:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448754.123360:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788448754.202572:0:24636:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788448754.202851:0:24636:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788448754.886317:0:23467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788448755.141967:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788448755.159025:0:24686:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448755.159264:0:24686:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788448756.158007:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448757.182013:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448757.245969:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448742/real 1788448742] req@ffff9fc083e4ea00 x1875323826459776/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448757 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448757.245997:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc083e4ea00 x1875323826459776/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448757 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448757.246006:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448742/real 1788448742] req@ffff9fc083e4d180 x1875323826459904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448757 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448757.246030:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc083e4d180 x1875323826459904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448757 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448757.246051:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448757.246083:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788448757.246087:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826459776:0@lo:8:kworker.0 00000100:00080000:3.0:1788448757.246092:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc188773000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448757.246097:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788448757.246100:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826459904:0@lo:8:kworker.0 00000100:00080000:0.0:1788448757.246686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448757.246690:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448757.246693:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448757.246696:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448757.246710:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448757.246713:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788448757.246716:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448757.246722:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:0.0:1788448757.246727:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788448757.246733:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc1bb74f000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448757.246750:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bb427100 x1875323826467072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448757.246763:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448757.246766:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788448757.246768:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc188773000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448757.246771:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:0.0:1788448757.246773:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788448757.246776:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc188773000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448757.246786:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bb424a80 x1875323826467200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448757.246823:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826466816:0@lo:400:kworker.0 00000100:00100000:0.0:1788448757.246912:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448757.246964:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826467584:0@lo:400:kworker.0 00000100:00100000:0.0:1788448757.246989:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448757.247007:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788448757.247013:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826466688:0@lo:400:kworker.0 00000100:00100000:0.0:1788448757.247035:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448757.247054:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826467456:0@lo:400:kworker.0 00000100:00100000:0.0:1788448757.247074:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448757.247104:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826466816 00000100:00100000:0.0:1788448757.247111:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826466816 00000100:00100000:0.0:1788448757.247139:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826467584 00000100:00100000:0.0:1788448757.247141:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826467584 00000100:00100000:2.0:1788448757.247265:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826466944:0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.247305:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448757.247327:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788448757.247333:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826466560:0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.247357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448757.247379:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826467328:0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.247399:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448757.247423:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826467456 00000100:00100000:2.0:1788448757.247427:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826467456 00000100:00100000:2.0:1788448757.247444:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826467328 00000100:00100000:2.0:1788448757.247446:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826467328 00000100:00100000:2.0:1788448757.247461:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448757.247469:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826466816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.247516:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826466816:12345-0@lo:400:kworker.0 Request processed in 47us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448757.247524:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448757.247541:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788448757.247547:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826467584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.247573:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826467584:12345-0@lo:400:kworker.0 Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448757.247596:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788448757.247609:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788448757.247623:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826467456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.247651:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826467456:12345-0@lo:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448757.247657:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788448757.247671:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788448757.247676:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826467328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.247706:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826467328:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448757.247712:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788448757.247731:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826466688 00000100:00100000:2.0:1788448757.247734:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826466688 00000100:00100000:2.0:1788448757.247757:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826466944 00000100:00100000:2.0:1788448757.247760:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826466944 00000100:00100000:2.0:1788448757.247773:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788448757.247779:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826466688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.247823:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826466688:12345-0@lo:400:kworker.0 Request processed in 44us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448757.247830:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788448757.247842:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448757.247848:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826466944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.247875:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826466944:12345-0@lo:400:kworker.0 Request processed in 27us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448757.247903:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448757.247926:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826466560 00000100:00100000:2.0:1788448757.247930:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826466560 00000100:00100000:2.0:1788448757.247954:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788448757.247960:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:3645:x1875323826466560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.247995:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:3645:x1875323826466560:12345-0@lo:400:kworker.0 Request processed in 35us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448757.248002:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788448757.248056:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826466560:0@lo:400:kworker.0 00010000:00080000:2.0:1788448757.248071:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb425880 x1875323826467328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448757.248081:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826467328:0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.248092:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826466944:0@lo:400:kworker.0 00000100:00100000:2.0:1788448757.248120:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826466688:0@lo:400:kworker.0 00010000:00080000:2.0:1788448757.248129:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb424e00 x1875323826467456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448757.248136:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826467456:0@lo:400:kworker.0 00010000:00080000:2.0:1788448757.248144:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb425500 x1875323826466816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448757.248151:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826466816:0@lo:400:kworker.0 00010000:00080000:2.0:1788448757.248159:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb425180 x1875323826467584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448757.248178:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826467584:0@lo:400:kworker.0 00000100:00080000:0.0:1788448757.248929:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448757.248935:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448757.248951:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826467072:0@lo:8:kworker.0 00000100:00100000:0.0:1788448757.248992:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448757.250858:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826467200:0@lo:8:kworker.0 00000100:00100000:0.0:1788448757.250921:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448757.252238:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826467072 00000100:00100000:3.0:1788448757.252248:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826467072 00000100:00100000:3.0:1788448757.252389:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826467200 00000100:00100000:3.0:1788448757.252394:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826467200 00000100:00100000:0.0:1788448757.252617:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448757.252624:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875323826467072:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788448757.252657:0:24221:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:0.0:1788448757.252688:0:24221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b80535c 00002000:00100000:0.0:1788448757.252702:0:24221:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9fc08260c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788448757.252719:0:24221:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788448757.252722:0:24221:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788448757.252877:0:24221:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788448757.252925:0:24221:0:(import.c:65:import_set_state_nolock()) ffff9fc08260a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448757.252989:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875323826467072:12345-0@lo:8:kworker.0 Request processed in 363us (3995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448757.252997:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448757.253014:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448757.253019:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875323826467200:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788448757.253031:0:24221:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788448757.263728:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb427100 x1875323826467072/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448757.263761:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788448757.263771:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788448757.263780:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788448757.263785:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788448757.263789:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788448757.263810:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788448757.263816:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826467072:0@lo:8:kworker.0 00000004:00080000:1.0:1788448757.263920:0:23455:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788448757.263954:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875323826467840:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788448757.264009:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448757.264035:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082640000 going to sleep for 11 seconds 00000004:00080000:1.0:1788448757.265942:0:23454:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788448757.266050:0:23454:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674611167741ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788448757.266066:0:23454:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788448757.266573:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826467712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448757.266647:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448757.266707:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826467712 00000100:00100000:1.0:1788448757.266714:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826467712 00000100:00100000:1.0:1788448757.267146:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448757.267158:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875323826467712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448757.267252:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788448757.267370:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875323826467712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 214us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448757.267378:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788448757.267423:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc083e4ca80 x1875323826467712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448757.267441:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826467712:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788448757.267471:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788448757.268973:0:23445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788448757.270591:0:24220:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788448757.270602:0:24220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788448757.271092:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826467840 00000100:00100000:1.0:1788448757.271103:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826467840 00000100:00100000:2.0:1788448757.271395:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448757.271406:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23455:x1875323826467840:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:1.0:1788448757.278523:0:24766:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788448757.278532:0:24766:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788448757.278622:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23455:x1875323826467840:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7214us (14608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448757.278643:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788448757.278694:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc083e4d880 x1875323826467840/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788448773 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448757.278720:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875323826467840:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788448757.278733:0:23455:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788448757.278784:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875323826467968:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788448757.278822:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448757.278843:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082640000 going to sleep for 11 seconds 00000100:00100000:1.0:1788448757.278861:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826467968 00000100:00100000:1.0:1788448757.278867:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826467968 00000100:00100000:1.0:1788448757.278923:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448757.278932:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23455:x1875323826467968:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788448757.278954:0:24220:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788448757.278985:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23455:x1875323826467968:12345-0@lo:5:osp-pre-0-1.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448757.278992:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788448757.279017:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc083e4d880 x1875323826467968/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448773 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448757.279027:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875323826467968:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788448757.279036:0:23455:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788448757.279070:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875323826468096:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788448757.279093:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448757.279107:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082640000 going to sleep for 11 seconds 00000100:00100000:1.0:1788448757.279118:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826468096 00000100:00100000:1.0:1788448757.279126:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826468096 00000100:00100000:1.0:1788448757.279145:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448757.279150:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23455:x1875323826468096:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788448757.279181:0:24220:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:0.0:1788448757.300407:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875323826467200:12345-0@lo:8:kworker.0 Request processed in 47376us (49476us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788448757.300421:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788448757.300471:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc188773000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448757.300477:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788448757.300481:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826467200:0@lo:8:kworker.0 00000001:00080000:2.0:1788448757.325439:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788448757.325463:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788448757.325734:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23455:x1875323826468096:12345-0@lo:5:osp-pre-0-1.0 Request processed in 46579us (46635us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788448757.325753:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788448757.325942:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc083e4d880 x1875323826468096/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448773 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448757.325954:0:23455:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788448757.325961:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875323826468096:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788448757.325976:0:23455:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1788448757.326022:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff48e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23455:1875323826468224:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788448757.326058:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448757.326129:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764780 going to sleep for 11 seconds 00000100:00100000:3.0:1788448757.326297:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826468224 00000100:00100000:3.0:1788448757.326304:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826468224 00000100:00100000:3.0:1788448757.326348:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448757.326358:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23455:x1875323826468224:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788448757.326414:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23455:x1875323826468224:12345-0@lo:900:osp-pre-0-1.0 Request processed in 59us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448757.326421:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788448757.326464:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bff48e00 x1875323826468224/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788448773 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448757.326474:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff48e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23455:1875323826468224:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788448757.961288:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826468352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448757.961353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448757.961418:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448757.961427:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826468480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448757.961453:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448757.961483:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826468352 00000100:00100000:3.0:1788448757.961500:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826468352 00000100:00100000:3.0:1788448757.961541:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826468480 00000100:00100000:3.0:1788448757.961545:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826468480 00000100:00100000:3.0:1788448757.961561:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788448757.961568:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826468352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448757.961611:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788448757.961656:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826468352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448757.961664:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788448757.961681:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788448757.961687:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826468480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448757.961704:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788448757.961734:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826468480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448757.961740:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788448757.961801:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826468352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448757.961830:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826468480:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788448758.206997:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448759.231001:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448760.255073:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448761.282234:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788448761.731686:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788448761.768693:0:25032:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788448761.768697:0:25032:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788448761.768698:0:25032:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788448761.768798:0:25032:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc082115800 00000020:01000004:1.0:1788448761.768813:0:25032:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788448761.768826:0:25032:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788448761.768838:0:25032:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fc1b5d599b8) 00000020:00000080:1.0:1788448761.768854:0:25032:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788448761.812173:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788448761.815999:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788448761.816871:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788448761.817285:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788448761.817661:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788448761.817991:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788448761.818306:0:25032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788448761.820360:0:25032:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788448761.820823:0:25032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788448761.820837:0:25032:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788448761.820855:0:25032:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45a9e4e6b80536a 00000020:01000004:2.0:1788448761.820864:0:25032:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788448761.821044:0:25032:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788448761.821047:0:25032:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788448761.821054:0:25032:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788448761.821093:0:25032:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788448761.821097:0:25032:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788448761.833633:0:25032:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788448761.833669:0:25032:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.121@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788448761.833674:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788448761.833676:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788448761.833677:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448761.833678:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448761.833679:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448761.833680:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448761.833681:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448761.833683:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448761.833685:0:25032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788448761.833688:0:25032:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788448761.833691:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788448761.833692:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788448761.833712:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448761.833713:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448761.833714:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448761.833715:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448761.833716:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448761.833717:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448761.833718:0:25032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788448761.833746:0:25032:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788448761.833768:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826468608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788448761.833855:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.833946:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448761.834013:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826468608 00000100:00100000:3.0:1788448761.834021:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826468608 00000100:00100000:3.0:1788448761.834083:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788448761.834093:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:25032:x1875323826468608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788448761.834120:0:22705:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788448761.834124:0:22705:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788448761.834127:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788448761.834471:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:25032:x1875323826468608:12345-0@lo:253:mount.lustre.0 Request processed in 378us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448761.834498:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788448761.835322:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826468608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788448761.835335:0:25032:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788448761.835338:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788448761.835339:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788448761.835340:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448761.835342:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448761.835343:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448761.835343:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448761.835345:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448761.835346:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448761.835347:0:25032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788448761.835376:0:25032:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc082115800 from lustre-OST0001 10000000:01000000:0.0:1788448761.835404:0:25032:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788448761.835407:0:25032:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788448761.835415:0:25032:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc1bb53cd28 local copy 00010000:00010000:0.0:1788448761.835435:0:25032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448761.835683:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826468736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448761.835723:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.835748:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.835817:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826468736 00000100:00100000:2.0:1788448761.835823:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826468736 00000100:00100000:2.0:1788448761.835869:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788448761.835878:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:25032:x1875323826468736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448761.835982:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:25032:x1875323826468736:12345-0@lo:501:mount.lustre.0 Request processed in 105us (258us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788448761.835988:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788448761.836290:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826468736:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788448761.836318:0:25032:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788448761.836337:0:25032:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788448761.836343:0:25032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448761.836352:0:25032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc400/0xf45a9e4e6b805084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80508b expref: -99 pid: 22689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448761.836395:0:25032:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc082115800 10000000:01000000:0.0:1788448761.836400:0:25032:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788448761.836404:0:25032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788448761.836407:0:25032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788448761.836411:0:25032:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788448761.836414:0:25032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788448761.836607:0:25032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b805371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448761.836617:0:25032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b805371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448761.836626:0:25032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b805371 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448761.836640:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826468864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788448761.836669:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.836697:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.836717:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826468864 00000100:00100000:2.0:1788448761.836726:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826468864 00000100:00100000:2.0:1788448761.836761:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788448761.836768:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:25032:x1875323826468864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448761.836777:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448761.836789:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1871e4a00/0xf45a9e4e6b805378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805371 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.836808:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1871e4a00/0xf45a9e4e6b805378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805371 expref: 22 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.836818:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1871e4a00/0xf45a9e4e6b805378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805371 expref: 22 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.836827:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e4a00, rc 0) 00000100:00100000:2.0:1788448761.836874:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:25032:x1875323826468864:12345-0@lo:101:mount.lustre.0 Request processed in 106us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448761.836901:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788448761.837259:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826468864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448761.837273:0:25032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b805371 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805378 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448761.837290:0:25032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b805371 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805378 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448761.839762:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788448761.840614:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448761.843266:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788448761.843323:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788448761.843338:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788448761.843350:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788448761.843361:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788448761.843371:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788448761.843395:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788448761.843410:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788448761.843435:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788448761.843464:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788448761.843471:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788448761.843593:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826468992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448761.843651:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.843690:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764900 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.844188:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826468992 00000100:00100000:2.0:1788448761.844196:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826468992 00000100:00100000:2.0:1788448761.844244:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788448761.844253:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:25032:x1875323826468992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448761.844411:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:25032:x1875323826468992:12345-0@lo:501:mount.lustre.0 Request processed in 159us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448761.844420:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788448761.844687:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826468992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448761.844725:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448761.844771:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448761.844803:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082640540 going to sleep for 11 seconds 00000100:00100000:0.0:1788448761.844894:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826469120 00000100:00100000:0.0:1788448761.844898:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826469120 00000100:00100000:0.0:1788448761.844925:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788448761.844932:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:25032:x1875323826469120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448761.846364:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:25032:x1875323826469120:12345-0@lo:503:mount.lustre.0 Request processed in 1426us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448761.846386:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788448761.846737:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469120:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788448761.847353:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448761.847724:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448761.847785:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448761.847865:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082640540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.848230:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826469248 00000100:00100000:2.0:1788448761.848238:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826469248 00000100:00100000:2.0:1788448761.848309:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788448761.848319:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:25032:x1875323826469248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448761.849001:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:25032:x1875323826469248:12345-0@lo:502:mount.lustre.0 Request processed in 682us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448761.849010:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788448761.849203:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448761.849649:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788448761.849699:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788448761.849714:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788448761.849735:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788448761.849755:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788448761.849767:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788448761.849778:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788448761.849789:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788448761.849799:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788448761.849828:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448761.849872:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448761.850240:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082640540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.850290:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826469376 00000100:00100000:2.0:1788448761.850297:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826469376 00000100:00100000:0.0:1788448761.850346:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788448761.850357:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:25032:x1875323826469376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448761.850501:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:25032:x1875323826469376:12345-0@lo:502:mount.lustre.0 Request processed in 145us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448761.850508:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788448761.850585:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448761.850632:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1788448761.850647:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788448761.852301:0:25036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788448761.852311:0:25036:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788448761.852317:0:25036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448761.852320:0:25036:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788448761.852326:0:25036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448761.852340:0:25036:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fc1bb798000) 00000020:00000080:3.0:1788448761.852365:0:25036:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788448761.852384:0:25036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788448761.852741:0:25036:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc082115800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788448761.852751:0:25036:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788448761.852759:0:25036:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45a9e4e6b805386 00010000:00010000:3.0:1788448761.861841:0:25036:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788448761.862685:0:25036:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1788448761.866293:0:25036:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788448761.869841:0:25036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788448761.869851:0:25036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448761.869857:0:25036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448761.869859:0:25036:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788448761.869862:0:25036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448761.869865:0:25036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448761.869866:0:25036:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788448761.869869:0:25036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788448761.869871:0:25036:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788448761.869879:0:25036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448761.869903:0:25036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448761.869904:0:25036:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788448761.869907:0:25036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448761.869909:0:25036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448761.869910:0:25036:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788448761.869913:0:25036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788448761.869938:0:25036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448761.869939:0:25036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448761.869941:0:25036:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788448761.869943:0:25036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788448761.870148:0:25032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788448761.870182:0:25032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788448761.870196:0:25032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b805371 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805378 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.870208:0:25032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b805371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805378 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448761.870215:0:25032:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc082115800 from 1 10000000:01000000:3.0:1788448761.870218:0:25032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448761.870249:0:25032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.870256:0:25032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.870277:0:25032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448761.870298:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788448761.870355:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448761.870398:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.871182:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826469504 00000100:00100000:2.0:1788448761.871190:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826469504 00000100:00100000:2.0:1788448761.871232:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788448761.871240:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:25032:x1875323826469504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448761.871252:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448761.871265:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1871e4000/0xf45a9e4e6b805394 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80538d expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.871288:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1871e4000/0xf45a9e4e6b805394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80538d expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.871297:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1871e4000/0xf45a9e4e6b805394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80538d expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.871305:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e4000, rc 0) 00000100:00100000:2.0:1788448761.871347:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:25032:x1875323826469504:12345-0@lo:101:mount.lustre.0 Request processed in 108us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448761.871353:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788448761.871710:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448761.871736:0:25032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.871745:0:25032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448761.874342:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788448761.875412:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448761.876350:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788448761.876961:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788448761.876980:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788448761.876994:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788448761.877007:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788448761.877019:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788448761.877656:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788448761.877676:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788448761.877690:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788448761.877705:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788448761.877721:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788448761.877745:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788448761.877751:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788448761.877850:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448761.877950:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448761.877990:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0834b49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448761.878191:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826469632 00000100:00100000:0.0:1788448761.878199:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826469632 00000100:00100000:0.0:1788448761.878247:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788448761.878257:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:25032:x1875323826469632:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448761.878385:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:25032:x1875323826469632:12345-0@lo:501:mount.lustre.0 Request processed in 129us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448761.878394:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788448761.879242:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448761.879283:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469760:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448761.879329:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448761.879359:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448761.879572:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826469760 00000100:00100000:0.0:1788448761.879577:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826469760 00000100:00100000:0.0:1788448761.879610:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788448761.879616:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:25032:x1875323826469760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448761.879703:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:25032:x1875323826469760:12345-0@lo:503:mount.lustre.0 Request processed in 87us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448761.879711:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788448761.880013:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469760:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788448761.881735:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788448761.881846:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448761.882981:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448761.883023:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:1.0:1788448761.884163:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826469888 00000100:00100000:1.0:1788448761.884174:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826469888 00000100:00100000:1.0:1788448761.884225:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788448761.884235:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:25032:x1875323826469888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448761.885632:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826469888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788448761.885859:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788448761.885917:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788448761.885935:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788448761.885951:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788448761.885964:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788448761.885978:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788448761.885992:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788448761.886007:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788448761.886020:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000100:00100000:1.0:1788448761.886148:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:25032:x1875323826469888:12345-0@lo:502:mount.lustre.0 Request processed in 767us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448761.886160:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000040:00080000:0.0:1788448761.886706:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788448761.886746:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788448761.886785:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448761.886839:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.886878:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448761.886905:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826470016 00000100:00100000:3.0:1788448761.886912:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826470016 00000100:00100000:3.0:1788448761.886960:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788448761.886969:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:25032:x1875323826470016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448761.887377:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:25032:x1875323826470016:12345-0@lo:502:mount.lustre.0 Request processed in 400us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448761.887384:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788448761.887650:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788448761.887694:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788448761.887701:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788448761.888786:0:25040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448761.888796:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448761.888799:0:25040:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788448761.888805:0:25040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc082115800 00000020:00000080:0.0:1788448761.888808:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448761.888816:0:25040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448761.888819:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448761.888820:0:25040:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788448761.888823:0:25040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448761.888825:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448761.888826:0:25040:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788448761.888829:0:25040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc082115800 00000020:00000080:0.0:1788448761.888831:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448761.888982:0:25040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448761.888987:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448761.888988:0:25040:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788448761.888991:0:25040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448761.888993:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448761.888995:0:25040:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788448761.888998:0:25040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc082115800 00000020:00000080:0.0:1788448761.889000:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448761.889804:0:25040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448761.889810:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448761.889811:0:25040:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788448761.889820:0:25040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448761.889823:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448761.889824:0:25040:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788448761.889828:0:25040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc082115800 00000020:00000080:0.0:1788448761.889830:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448761.889863:0:25040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448761.889865:0:25040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448761.889867:0:25040:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788448761.889870:0:25040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788448761.890341:0:25032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788448761.890372:0:25032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448761.890394:0:25032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.890410:0:25032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448761.890462:0:25032:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788448761.890465:0:25032:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc082115800 10000000:01000000:3.0:1788448761.890468:0:25032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc082115800 10000000:01000000:3.0:1788448761.890472:0:25032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788448761.890477:0:25032:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc082115800 from 1 10000000:01000000:3.0:1788448761.890480:0:25032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448761.890511:0:25032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8a00/0xf45a9e4e6b80539b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.890518:0:25032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8a00/0xf45a9e4e6b80539b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.890529:0:25032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8a00/0xf45a9e4e6b80539b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448761.890549:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788448761.890617:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448761.890658:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.891250:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826470144 00000100:00100000:2.0:1788448761.891258:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826470144 00000100:00100000:2.0:1788448761.891342:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788448761.891352:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:25032:x1875323826470144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448761.891375:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448761.891389:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1871e5200/0xf45a9e4e6b8053a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80539b expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.891417:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1871e5200/0xf45a9e4e6b8053a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80539b expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.891440:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1871e5200/0xf45a9e4e6b8053a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80539b expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.891449:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e5200, rc 0) 00000100:00100000:2.0:1788448761.891501:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826470144:12345-0@lo:101:mount.lustre.0 Request processed in 151us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448761.891508:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788448761.891828:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448761.891843:0:25032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8a00/0xf45a9e4e6b80539b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8053a2 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.891852:0:25032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8a00/0xf45a9e4e6b80539b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8053a2 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448761.893872:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788448761.894305:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448761.894759:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788448761.894785:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788448761.894799:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788448761.894814:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788448761.894827:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788448761.894841:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788448761.894855:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788448761.894867:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788448761.894898:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788448761.894915:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788448761.894929:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788448761.894942:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788448761.894956:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788448761.894970:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788448761.895251:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788448761.895281:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788448761.895297:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788448761.895310:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788448761.895324:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788448761.895337:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788448761.895350:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788448761.895363:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788448761.895636:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788448761.895661:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788448761.895674:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788448761.895688:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788448761.895702:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788448761.895716:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788448761.895730:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788448761.895754:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788448761.895769:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788448761.895796:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788448761.895812:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788448761.895826:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788448761.895841:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788448761.895856:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788448761.895870:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788448761.896621:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788448761.896646:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788448761.896660:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788448761.896673:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788448761.896686:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788448761.896699:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788448761.896712:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788448761.896725:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788448761.896738:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788448761.896750:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788448761.896775:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788448761.896925:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788448761.896945:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788448761.896963:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788448761.896968:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788448761.897294:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448761.897356:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448761.897664:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.897717:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826470272 00000100:00100000:2.0:1788448761.897725:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826470272 00000100:00100000:2.0:1788448761.897808:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788448761.897818:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826470272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448761.897963:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826470272:12345-0@lo:501:mount.lustre.0 Request processed in 146us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448761.897971:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788448761.898216:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448761.898247:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448761.898285:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448761.898305:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.898378:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826470400 00000100:00100000:2.0:1788448761.898383:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826470400 00000100:00100000:2.0:1788448761.898407:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788448761.898414:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826470400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448761.898674:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826470400:12345-0@lo:503:mount.lustre.0 Request processed in 259us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448761.898681:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788448761.898765:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470400:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788448761.899669:0:25032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788448761.899735:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448761.899781:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448761.899817:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.899868:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826470528 00000100:00100000:2.0:1788448761.899873:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826470528 00000100:00100000:2.0:1788448761.900327:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788448761.900336:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826470528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448761.900454:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826470528:12345-0@lo:502:mount.lustre.0 Request processed in 119us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448761.900461:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788448761.901328:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448761.901546:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788448761.901582:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788448761.901595:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788448761.901607:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788448761.901618:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788448761.901630:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788448761.901642:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788448761.901653:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788448761.901664:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788448761.901687:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788448761.901699:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788448761.901710:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788448761.901720:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788448761.901732:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788448761.901742:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788448761.901753:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788448761.901763:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788448761.901774:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788448761.901784:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788448761.901795:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788448761.901805:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788448761.901816:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788448761.901826:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788448761.901838:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788448761.901858:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788448761.901899:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788448761.901915:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788448761.901925:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788448761.901936:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788448761.901947:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788448761.901958:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788448761.901968:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788448761.901980:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788448761.901993:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788448761.902004:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788448761.902014:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788448761.902036:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788448761.902050:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788448761.902073:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788448761.902087:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788448761.902099:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788448761.902125:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788448761.902140:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788448761.902152:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788448761.902165:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788448761.902178:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788448761.902190:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788448761.902202:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788448761.902245:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448761.902300:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448761.902341:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826470656 00000100:00100000:3.0:1788448761.902347:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826470656 00000100:00100000:3.0:1788448761.902379:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788448761.902387:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826470656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448761.902476:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826470656:12345-0@lo:502:mount.lustre.0 Request processed in 89us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448761.902488:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788448761.902535:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448761.902563:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448761.902689:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788448761.902710:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788448761.902729:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448761.902763:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448761.902793:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.903202:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826470784 00000100:00100000:2.0:1788448761.903208:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826470784 00000100:00100000:2.0:1788448761.903237:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788448761.903243:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826470784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448761.903317:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826470784:12345-0@lo:502:mount.lustre.0 Request processed in 74us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448761.903324:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788448761.903700:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826470784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448761.903743:0:25032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788448761.903751:0:25032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788448761.909422:0:25045:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788448761.909439:0:25045:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fc08242cd28) 00000020:00000080:0.0:1788448761.909462:0:25045:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788448761.909536:0:25045:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc082115800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788448761.909540:0:25045:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc082115800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788448761.909543:0:25045:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc082115800 3 00010000:00080000:0.0:1788448761.909581:0:25045:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc083653000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448761.912599:0:25045:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788448761.913802:0:25045:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788448761.913846:0:25045:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788448761.913869:0:25045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf45a9e4e6b8053b0 00000100:00080000:0.0:1788448761.913900:0:25045:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448761.913907:0:25045:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc083653000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448761.913942:0:25045:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bb425c00 x1875323826470912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448761.914516:0:25045:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788448761.914580:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448761.914584:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448761.914586:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448761.914589:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448761.914627:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448761.914630:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788448761.914632:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc188773000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448761.914637:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 674 00000100:00080000:0.0:1788448761.914642:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788448761.914646:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc188773000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448761.914660:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bb425500 x1875323826471552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448761.914704:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826471040:0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.914761:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.914794:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826471680:0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.914817:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.914841:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448761.914847:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826471424:0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.914872:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448761.914916:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826471424 00000100:00100000:1.0:1788448761.914923:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826471424 00000100:00100000:0.0:1788448761.914923:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826471168:0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.914944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.914958:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826471808:0@lo:400:kworker.0 00000100:00100000:1.0:1788448761.914968:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448761.914977:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826471424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448761.915026:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826471424:12345-0@lo:400:kworker.0 Request processed in 50us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448761.915033:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788448761.915052:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448761.915140:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826470912:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448761.915183:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448761.915210:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826471552:0@lo:8:kworker.0 00000100:00100000:2.0:1788448761.915230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448761.915256:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826471552 00000100:00100000:2.0:1788448761.915260:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826471552 00000100:00100000:2.0:1788448761.915280:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448761.915285:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875323826471552:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788448761.915328:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875323826471552:12345-0@lo:8:kworker.0 Request processed in 42us (97us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788448761.915334:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448761.915361:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448761.915368:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc188773000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448761.915372:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788448761.915384:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826471552:0@lo:8:kworker.0 00000100:00100000:0.0:1788448761.915491:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.915508:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788448761.915514:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826471296:0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.915537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.915577:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826471936:0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.915597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.915630:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826471040 00000100:00100000:0.0:1788448761.915634:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826471040 00000100:00100000:0.0:1788448761.915661:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826471296 00000100:00100000:0.0:1788448761.915664:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826471296 00000100:00100000:0.0:1788448761.915678:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788448761.915684:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826471040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.915718:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826471040:12345-0@lo:400:kworker.0 Request processed in 33us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448761.915725:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788448761.915738:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788448761.915744:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826471296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.915775:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826471296:12345-0@lo:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448761.915780:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788448761.915796:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826471680 00000100:00100000:0.0:1788448761.915799:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826471680 00000100:00100000:0.0:1788448761.915815:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826471168 00000100:00100000:0.0:1788448761.915817:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826471168 00000100:00100000:0.0:1788448761.915827:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826470912 00000100:00100000:0.0:1788448761.915829:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826470912 00000100:00100000:0.0:1788448761.915837:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826471808 00000100:00100000:0.0:1788448761.915839:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826471808 00000100:00100000:0.0:1788448761.915857:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826471936 00000100:00100000:0.0:1788448761.915860:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826471936 00000100:00100000:0.0:1788448761.915874:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448761.915903:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826471680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.915935:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826471680:12345-0@lo:400:kworker.0 Request processed in 55us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448761.915941:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448761.915960:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448761.915966:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826471168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.916661:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826471168:12345-0@lo:400:kworker.0 Request processed in 692us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448761.916669:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448761.916686:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448761.916693:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826471808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.916738:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826471808:12345-0@lo:400:kworker.0 Request processed in 46us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448761.916744:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448761.916757:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448761.916763:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826471936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448761.916790:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826471936:12345-0@lo:400:kworker.0 Request processed in 27us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448761.916795:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448761.916807:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448761.916811:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826470912:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788448761.916831:0:22712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:0.0:1788448761.916872:0:22712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf45a9e4e6b8053b7 00010000:00080000:2.0:1788448761.916988:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb425180 x1875323826471424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448761.917001:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826471424:0@lo:400:kworker.0 00000100:00100000:2.0:1788448761.917015:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826471040:0@lo:400:kworker.0 00010000:00080000:2.0:1788448761.917027:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb424e00 x1875323826471680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448761.917036:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826471680:0@lo:400:kworker.0 00000004:00100000:0.0:1788448761.917574:0:22712:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788448761.917608:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9fc08260d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448761.917708:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875323826470912:12345-0@lo:38:llog_process_th.0 Request processed in 895us (2523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448761.917716:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788448761.917742:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448761.917753:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448761.917775:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826471296:0@lo:400:kworker.0 00010000:00080000:0.0:1788448761.917786:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb426680 x1875323826471936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448761.917795:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826471936:0@lo:400:kworker.0 00010000:00080000:0.0:1788448761.917805:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb424a80 x1875323826471168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448761.917812:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826471168:0@lo:400:kworker.0 00010000:00080000:0.0:1788448761.917821:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb424700 x1875323826471808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448761.917827:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826471808:0@lo:400:kworker.0 00000020:01000004:3.0:1788448761.919932:0:25045:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788448761.919948:0:25045:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9fc1bb7999b8) 00000020:00000080:3.0:1788448761.919969:0:25045:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788448761.920047:0:25045:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc082115800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788448761.920051:0:25045:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc082115800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788448761.920054:0:25045:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc082115800 3 00010000:00080000:3.0:1788448761.920081:0:25045:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc083f21800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.121@tcp at head 00010000:00080000:2.0:1788448761.920262:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb425c00 x1875323826470912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448761.920273:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448761.920281:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788448761.920289:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788448761.920293:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788448761.920296:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc083653000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448761.920302:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826470912:0@lo:38:llog_process_th.0 00010000:00010000:0.0:1788448761.924392:0:25045:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788448761.924604:0:25045:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788448761.924648:0:25045:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788448761.924672:0:25045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf45a9e4e6b8053c5 00000100:00080000:0.0:1788448761.924681:0:25045:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448761.924687:0:25045:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9fc083f21800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448761.924733:0:25045:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0836e9f80 x1875323826472064/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448761.924754:0:25045:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788448761.924921:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448761.924932:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448761.924934:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448761.924937:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788448761.925803:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875323826472064:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448761.925869:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448761.925972:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826472064 00000100:00100000:3.0:1788448761.925980:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826472064 00000100:00100000:3.0:1788448761.926021:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788448761.926028:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875323826472064:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788448761.926062:0:22711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:3.0:1788448761.926124:0:22711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf45a9e4e6b8053cc 00000004:00100000:3.0:1788448761.926141:0:22711:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788448761.926169:0:22711:0:(import.c:65:import_set_state_nolock()) ffff9fc083f25800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448761.926225:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875323826472064:12345-0@lo:38:llog_process_th.0 Request processed in 195us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448761.926233:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788448761.926356:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc0836e9f80 x1875323826472064/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448761.926377:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448761.926386:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788448761.926392:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788448761.926402:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788448761.926404:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc083f21800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448761.926410:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875323826472064:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788448761.929396:0:25045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788448761.929937:0:25032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788448761.929965:0:25032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788448761.929977:0:25032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8a00/0xf45a9e4e6b80539b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8053a2 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.929988:0:25032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8a00/0xf45a9e4e6b80539b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8053a2 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788448761.930038:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788448761.930040:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788448761.930041:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448761.930042:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448761.930043:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448761.930044:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448761.930045:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448761.930047:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448761.930048:0:25032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788448761.930052:0:25032:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788448761.930061:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788448761.930062:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788448761.930063:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448761.930064:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448761.930065:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448761.930067:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448761.930068:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448761.930069:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448761.930070:0:25032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788448761.930091:0:25032:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788448761.930115:0:25032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826472192:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788448761.930175:0:25032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448761.930207:0:25032:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448761.931675:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826472192 00000100:00100000:2.0:1788448761.931685:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826472192 00000100:00100000:2.0:1788448761.931734:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788448761.931743:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826472192:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788448761.931772:0:22703:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788448761.931786:0:22703:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788448761.941105:0:22703:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788448761.941125:0:22703:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788448761.941173:0:22726:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788448761.941179:0:22726:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788448761.941201:0:22726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.941219:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b805347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805340 expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.941226:0:22726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80534e expref: 24 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.941233:0:22726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.941271:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80534e expref: 24 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.941284:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80534e expref: 24 pid: 22703 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448761.941308:0:22726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826472320:0@lo:104: 00000100:00100000:2.0:1788448761.941363:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448761.941415:0:22726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b805347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b805340 expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.941433:0:22726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b805347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b805340 expref: 24 pid: 22704 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448761.941443:0:22726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826472448:0@lo:104: 00000100:00100000:2.0:1788448761.941464:0:22726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448761.941495:0:22726:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448761.941763:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826472320 00000100:00100000:3.0:1788448761.941771:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826472320 00000100:00100000:3.0:1788448761.941805:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826472448 00000100:00100000:3.0:1788448761.941808:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826472448 00000100:00100000:3.0:1788448761.941823:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788448761.941832:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+4:22726:x1875323826472320:12345-0@lo:104: 00010000:00010000:3.0:1788448761.941844:0:22693:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.941920:0:22693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788448761.941926:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+4:22726:x1875323826472320:12345-0@lo:104: Request processed in 95us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448761.941933:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788448761.941949:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448761.941954:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:22726:x1875323826472448:12345-0@lo:104: 00010000:00010000:3.0:1788448761.941962:0:22693:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.941993:0:22693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788448761.941998:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:22726:x1875323826472448:12345-0@lo:104: Request processed in 44us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448761.942004:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788448761.942020:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448761.942036:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.942044:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448761.942048:0:22698:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.942066:0:22698:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448761.942073:0:22698:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448761.942079:0:22698:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448761.942118:0:22698:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.942125:0:22698:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448761.942148:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.942156:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd200/0xf45a9e4e6b80534e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805355 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.942166:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448761.942169:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.942174:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448761.942176:0:22698:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.942182:0:22698:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448761.942188:0:22698:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448761.942199:0:22698:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448761.942214:0:22698:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.942220:0:22698:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448761.942226:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448761.942231:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b805340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805347 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448761.942239:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3647:1875323826472576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448761.942244:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448761.942245:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448761.942247:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448761.942270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448761.942298:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448761.942304:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3647:1875323826472704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448761.942325:0:22726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826472320:0@lo:104: 00000100:00100000:0.0:1788448761.942325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448761.942333:0:22726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22726:1875323826472448:0@lo:104: 00010000:00010000:2.0:1788448761.942350:0:22726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448761.942410:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:25032:x1875323826472192:12345-0@lo:253:mount.lustre.0 Request processed in 10667us (12234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448761.942418:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:1.0:1788448761.942775:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448761.942786:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826472576 00000100:00100000:1.0:1788448761.942790:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826472576 00010000:00010000:1.0:1788448761.942813:0:22695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80534e expref: 24 pid: 22703 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448761.942841:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826472704 00000100:00100000:1.0:1788448761.942844:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826472704 00010000:00010000:1.0:1788448761.942856:0:22695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b805347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805340 expref: 25 pid: 22704 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448761.942869:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448761.942876:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+25:3647:x1875323826472576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448761.942966:0:22695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448761.942972:0:22695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80534e expref: 25 pid: 22703 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.942983:0:22695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80534e expref: 25 pid: 22703 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.942996:0:22695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b805355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80534e expref: 25 pid: 22703 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943008:0:22695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448761.943044:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:3647:x1875323826472576:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448761.943060:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448761.943075:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448761.943081:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:3647:x1875323826472704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448761.943089:0:22695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448761.943107:0:22695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b805347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b805340 expref: 23 pid: 22704 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943117:0:22695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b805347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b805340 expref: 23 pid: 22704 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943128:0:22695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b805347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b805340 expref: 23 pid: 22704 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943138:0:22695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943145:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788448761.943158:0:22695:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006583163s 00010000:00010000:1.0:1788448761.943162:0:22695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943168:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943174:0:22695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943179:0:22695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943191:0:22695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e4200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448761.943194:0:22695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943201:0:22695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943213:0:22695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448761.943222:0:22695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448761.943248:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:3647:x1875323826472704:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448761.943254:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448761.943285:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3647:1875323826472704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448761.943294:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3647:1875323826472576:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448761.943390:0:22726:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.943398:0:22726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448761.943404:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1871e4200/0xf45a9e4e6b8053d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448761.945632:0:25032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44e7ff6c-6b3b-4629-bf03-6edc4527824b:25032:1875323826472192:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788448761.945650:0:25032:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788448761.945652:0:25032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788448761.945654:0:25032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788448761.945656:0:25032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448761.945657:0:25032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448761.945658:0:25032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448761.945659:0:25032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448761.945661:0:25032:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448761.945662:0:25032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448761.945664:0:25032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788448761.945678:0:25032:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788448761.947748:0:25032:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788448761.952016:0:25032:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788448761.952034:0:25032:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788448761.952575:0:25032:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788448761.952616:0:25032:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788448761.952637:0:25032:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788448761.952652:0:25032:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788448761.956991:0:25032:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788448761.959328:0:25032:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788448762.302263:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448762.558350:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826472832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448762.558412:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448762.563488:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826472832 00000100:00100000:1.0:1788448762.563504:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826472832 00000100:00100000:1.0:1788448762.563579:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448762.563589:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826472832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448762.563617:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788448762.563740:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826472832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (5327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448762.563747:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788448762.564347:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083e4ea00 x1875323826472832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448762.564370:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826472832:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788448762.798330:0:25098:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788448762.798864:0:25098:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788448763.081297:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448763.081326:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826472960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448763.081414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448763.081593:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826472960 00000100:00100000:0.0:1788448763.081603:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826472960 00000100:00100000:0.0:1788448763.081656:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788448763.081666:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826472960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448763.081775:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788448763.081833:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826472960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448763.081841:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788448763.081913:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826472960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448763.081999:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448763.082012:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826473088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448763.082051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448763.082091:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826473088 00000100:00100000:2.0:1788448763.082096:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826473088 00000100:00100000:2.0:1788448763.082123:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448763.082131:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826473088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788448763.082152:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788448763.082188:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826473088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448763.082194:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448763.082226:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826473088:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788448763.328522:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788448763.582020:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788448763.582031:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc083f6a800 from 14 10000000:01000000:2.0:1788448763.582038:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788448763.582106:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b8053da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448763.582119:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b8053da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448763.582152:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b8053da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448763.582187:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826473216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448763.582283:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448763.582346:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448763.582716:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826473216 00000100:00100000:3.0:1788448763.582728:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826473216 00000100:00100000:3.0:1788448763.582802:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788448763.582812:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:22707:x1875323826473216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448763.582828:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448763.582845:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8053e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8053da expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448763.582872:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8053e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8053da expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448763.582914:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8053e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8053da expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448763.582925:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9c00, rc 0) 00000100:00100000:3.0:1788448763.582979:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:22707:x1875323826473216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448763.582987:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788448763.583095:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826473216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448763.583119:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b8053da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8053e1 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448763.583129:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b8053da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8053e1 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448763.583190:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826473344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788448763.583230:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448763.583267:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba21c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448763.583336:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826473344 00000100:00100000:0.0:1788448763.583341:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826473344 00000100:00100000:0.0:1788448763.583380:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788448763.583388:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:22707:x1875323826473344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788448763.583405:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788448763.583431:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788448763.583434:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788448763.583527:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:22707:x1875323826473344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448763.583535:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788448763.583586:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826473344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788448763.583656:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788448763.583664:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b8053da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8053e1 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448763.583673:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e4200/0xf45a9e4e6b8053da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8053e1 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448763.583684:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788448763.583686:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc1bfee5000 from 14 10000000:01000000:0.0:1788448763.583689:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788448763.583711:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b8053e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448763.583719:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b8053e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448763.583727:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b8053e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448763.583741:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826473472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448763.583768:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448763.583783:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448763.583794:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826473472 00000100:00100000:0.0:1788448763.583804:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826473472 00000100:00100000:0.0:1788448763.583824:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788448763.583830:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:22707:x1875323826473472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448763.583838:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448763.583848:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b8053ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8053e8 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448763.583866:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b8053ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8053e8 expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448763.583875:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b8053ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8053e8 expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448763.583917:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f600, rc 0) 00000100:00100000:0.0:1788448763.583948:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:22707:x1875323826473472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448763.583954:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788448763.583984:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826473472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448763.583994:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b8053e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8053ef expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448763.584002:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b8053e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8053ef expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448763.584043:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826473600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788448763.584072:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448763.584092:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448763.584102:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826473600 00000100:00100000:0.0:1788448763.584110:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826473600 00000100:00100000:0.0:1788448763.584127:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788448763.584133:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:22707:x1875323826473600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788448763.584143:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788448763.584153:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788448763.584156:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788448763.584218:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:22707:x1875323826473600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 84us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448763.584224:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788448763.584250:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826473600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788448763.584290:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788448763.584296:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b8053e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8053ef expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448763.584305:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e400/0xf45a9e4e6b8053e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8053ef expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448764.033593:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448744/real 1788448744] req@ffff9fc1ba34e680 x1875323826460288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448764.033635:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc1ba34e680 x1875323826460288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448764 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448764.033647:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448744/real 1788448744] req@ffff9fc1ba34dc00 x1875323826460416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448764.033660:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc1ba34dc00 x1875323826460416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448764 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788448764.033748:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc083f69800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448764.033779:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448764.033784:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826460288:0@lo:8:kworker.0 00000100:00080000:1.0:1788448764.033791:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc182d6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448764.033796:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448764.033799:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826460416:0@lo:8:kworker.0 00000100:00080000:0.0:1788448764.037620:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448764.037628:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788448764.037634:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc083f69800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448764.037644:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 661 00000100:00080000:0.0:1788448764.037651:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788448764.037659:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc083f69800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448764.037689:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0836e9180 x1875323826473984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448764.037709:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448764.037720:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788448764.037722:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc182d6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448764.037726:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 661 00000100:00080000:0.0:1788448764.037729:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788448764.037732:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc182d6f000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448764.037745:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0836e8380 x1875323826474112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448764.037775:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448764.037779:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788448764.037781:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc188773000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448764.037787:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc188773000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448764.037810:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0836ea680 x1875323826474624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448764.037895:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826473728:0@lo:400:kworker.0 00000100:00100000:1.0:1788448764.037945:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826473856:0@lo:400:kworker.0 00000100:00100000:0.0:1788448764.037981:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448764.038001:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.038030:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826474496:0@lo:400:kworker.0 00000100:00100000:1.0:1788448764.038042:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826474752:0@lo:400:kworker.0 00000100:00100000:0.0:1788448764.038058:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.038079:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826475136:0@lo:400:kworker.0 00000100:00100000:1.0:1788448764.038086:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.038114:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448764.038117:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826475264:0@lo:400:kworker.0 00000100:00100000:0.0:1788448764.038145:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788448764.038152:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826474368:0@lo:400:kworker.0 00000100:00100000:1.0:1788448764.038160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448764.038783:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788448764.038793:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826474240:0@lo:400:kworker.0 00000100:00100000:1.0:1788448764.038828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448764.038842:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826474880:0@lo:400:kworker.0 00000100:00100000:1.0:1788448764.038865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448764.039929:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826473856 00000100:00100000:2.0:1788448764.039942:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826473856 00000100:00100000:2.0:1788448764.040005:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788448764.040014:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826473856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448764.040099:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826473856:12345-0@lo:400:kworker.0 Request processed in 86us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448764.040107:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788448764.040132:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826474752 00000100:00100000:2.0:1788448764.040136:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826474752 00000100:00100000:2.0:1788448764.040153:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826475136 00000100:00100000:2.0:1788448764.040156:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826475136 00000100:00100000:2.0:1788448764.040200:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826475264 00000100:00100000:2.0:1788448764.040203:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826475264 00000100:00100000:2.0:1788448764.040214:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826474240 00000100:00100000:2.0:1788448764.040217:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826474240 00000100:00100000:2.0:1788448764.040227:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826474880 00000100:00100000:2.0:1788448764.040230:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826474880 00000100:00100000:2.0:1788448764.040241:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448764.040247:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826474752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448764.041046:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826474752:12345-0@lo:400:kworker.0 Request processed in 794us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448764.041056:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448764.041090:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788448764.041097:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826475136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448764.041138:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826475136:12345-0@lo:400:kworker.0 Request processed in 42us (3025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448764.041144:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788448764.041153:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788448764.041159:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826475264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448764.041385:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448764.041474:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826474368 00000100:00100000:1.0:1788448764.041483:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826474368 00000100:00100000:1.0:1788448764.041526:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788448764.041536:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826474368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448764.041661:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826473984:0@lo:8:kworker.0 00000100:00100000:0.0:1788448764.041703:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.041751:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826474112:0@lo:8:kworker.0 00000100:00100000:0.0:1788448764.041777:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.042697:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826474624:0@lo:8:kworker.0 00000100:00100000:0.0:1788448764.042740:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.043518:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826473728 00000100:00100000:0.0:1788448764.043531:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826473728 00000100:00100000:0.0:1788448764.043604:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788448764.043613:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:3648:x1875323826473728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448764.043681:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:3648:x1875323826473728:12345-0@lo:400:kworker.0 Request processed in 68us (5701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448764.043688:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788448764.043737:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826474496 00000100:00100000:0.0:1788448764.043742:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826474496 00000100:00100000:0.0:1788448764.043770:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826473984 00000100:00100000:0.0:1788448764.043773:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826473984 00000100:00100000:0.0:1788448764.043783:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826474112 00000100:00100000:0.0:1788448764.043786:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826474112 00000100:00100000:0.0:1788448764.043875:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826474624 00000100:00100000:0.0:1788448764.043895:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826474624 00000100:00100000:0.0:1788448764.043909:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448764.043917:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826474496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448764.043954:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826474496:12345-0@lo:400:kworker.0 Request processed in 38us (5896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448764.043960:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448764.043975:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448764.043980:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1875323826473984:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788448764.044010:0:24766:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:0.0:1788448764.044046:0:24766:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b8053f6 00002000:00100000:0.0:1788448764.044073:0:24766:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fc082676000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788448764.044078:0:24766:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788448764.044081:0:24766:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788448764.044177:0:24766:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788448764.044206:0:24766:0:(import.c:65:import_set_state_nolock()) ffff9fc082676800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448764.044254:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875323826473984:12345-0@lo:8:kworker.0 Request processed in 273us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448764.044260:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448764.044274:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448764.044277:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1875323826474112:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788448764.044311:0:24766:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:0.0:1788448764.044334:0:24766:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b8053fd 00002000:00100000:0.0:1788448764.044341:0:24766:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fc082674800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788448764.044344:0:24766:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788448764.044347:0:24766:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788448764.044511:0:24766:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788448764.044526:0:24766:0:(import.c:65:import_set_state_nolock()) ffff9fc082677000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448764.044570:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875323826474112:12345-0@lo:8:kworker.0 Request processed in 290us (2791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448764.044577:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448764.044590:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448764.044595:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1875323826474624:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788448764.044611:0:24766:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:0.0:1788448764.044627:0:24766:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b805404 00002000:00100000:0.0:1788448764.044633:0:24766:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9fc082671000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788448764.044645:0:24766:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788448764.044648:0:24766:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788448764.044671:0:24766:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788448764.044684:0:24766:0:(import.c:65:import_set_state_nolock()) ffff9fc082677800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448764.044715:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1875323826474624:12345-0@lo:8:kworker.0 Request processed in 119us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448764.044721:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448764.044749:0:22712:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788448764.044758:0:22712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788448764.044779:0:22711:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788448764.044788:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788448764.045910:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826474240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448764.045982:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826474240:12345-0@lo:400:kworker.0 Request processed in 86us (7154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448764.045989:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788448764.046019:0:22711:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788448764.046029:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788448764.046036:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826474880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448764.046068:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826474880:12345-0@lo:400:kworker.0 Request processed in 32us (7202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448764.046073:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788448764.046098:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448764.046104:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448764.046107:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788448764.046171:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e9180 x1875323826473984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448764.046397:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788448764.046410:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788448764.046505:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788448764.046510:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788448764.046515:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc083f69800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788448764.046564:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788448764.046572:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826473984:0@lo:8:kworker.0 00010000:00080000:0.0:1788448764.046591:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e8380 x1875323826474112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448764.046600:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788448764.046604:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788448764.046610:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788448764.046612:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788448764.046615:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc182d6f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788448764.046628:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788448764.046632:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826474112:0@lo:8:kworker.0 00010000:00080000:0.0:1788448764.046646:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836ea680 x1875323826474624/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788448764.046657:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788448764.046662:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788448764.046665:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788448764.046667:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc188773000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788448764.046679:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788448764.046683:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826474624:0@lo:8:kworker.0 00000004:00080000:0.0:1788448764.050286:0:22735:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1788448764.050322:0:22735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22735:1875323826475520:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788448764.050402:0:22735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.050445:0:22735:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a83c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788448764.050488:0:22737:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788448764.050502:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22737:1875323826475776:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788448764.050528:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.050555:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a8300 going to sleep for 11 seconds 00000004:00080000:0.0:1788448764.050945:0:23457:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788448764.050966:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875323826476032:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788448764.050997:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.051015:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448764.051031:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826475392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448764.051057:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.051100:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826475520 00000100:00100000:0.0:1788448764.051108:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826475520 00000100:00100000:0.0:1788448764.051167:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826475776 00000100:00100000:0.0:1788448764.051171:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826475776 00000100:00100000:0.0:1788448764.051195:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826476032 00000100:00100000:0.0:1788448764.051198:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826476032 00000100:00100000:0.0:1788448764.051217:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448764.051227:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22735:x1875323826475520:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788448764.051710:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448764.051720:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22737:x1875323826475776:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1788448764.051903:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448764.051908:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448764.051928:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826475008:0@lo:400:kworker.0 00000100:00100000:0.0:1788448764.051971:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.052015:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826473728:0@lo:400:kworker.0 00010000:00080000:0.0:1788448764.052044:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e8700 x1875323826474496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448764.052057:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826474496:0@lo:400:kworker.0 00010000:00080000:0.0:1788448764.052070:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08201bb80 x1875323826475136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448764.052079:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826475136:0@lo:400:kworker.0 00000100:00100000:0.0:1788448764.052107:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826475904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448764.052130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.052161:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448764.052169:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826475648:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788448764.052447:0:22734:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788448764.052595:0:22734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681397712713ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788448764.052606:0:22734:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788448764.052638:0:22736:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788448764.052676:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.052712:0:22711:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788448764.052722:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826475008 00000100:00100000:0.0:1788448764.052726:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826475008 00000100:00100000:0.0:1788448764.052767:0:22711:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788448764.052775:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788448764.052783:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826475008:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1788448764.052806:0:22736:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681397800943ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788448764.052818:0:22736:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788448764.052831:0:23456:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788448764.052905:0:23456:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 681398022671ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788448764.052913:0:23456:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788448764.052938:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826475008:12345-0@lo:400:kworker.0 Request processed in 154us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448764.052939:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826475392 00000100:00100000:1.0:1788448764.052946:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826475392 00000100:00100000:0.0:1788448764.052952:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448764.052975:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826475904 00000100:00100000:1.0:1788448764.052980:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826475904 00000100:00080000:0.0:1788448764.052980:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448764.052993:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826475648 00000100:00100000:1.0:1788448764.053004:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826475648 00000100:00100000:1.0:1788448764.053025:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448764.053033:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875323826475392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448764.053058:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788448764.053116:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875323826475392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448764.053125:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448764.053146:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448764.053154:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875323826475904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788448764.053174:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788448764.053205:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875323826475904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448764.053211:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448764.053223:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448764.053229:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875323826475648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448764.053238:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788448764.053261:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875323826475648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448764.053268:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00080000:0.0:1788448764.054380:0:24219:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788448764.054390:0:24219:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:0.0:1788448764.054397:0:24219:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00010000:00080000:1.0:1788448764.054466:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc082019500 x1875323826475392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448764.054504:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826475392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448764.054666:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826474368:12345-0@lo:400:kworker.0 Request processed in 13131us (13280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448764.054676:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788448764.054939:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826475264:12345-0@lo:400:kworker.0 Request processed in 13773us (16776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448764.054952:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788448764.056909:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836eaa00 x1875323826474240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448764.056938:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826474240:0@lo:400:kworker.0 00010000:00080000:2.0:1788448764.056971:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08201b480 x1875323826474880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448764.056981:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826474880:0@lo:400:kworker.0 00000100:00100000:2.0:1788448764.056996:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826473856:0@lo:400:kworker.0 00010000:00080000:2.0:1788448764.057011:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e9f80 x1875323826474752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448764.057020:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826474752:0@lo:400:kworker.0 00010000:00080000:2.0:1788448764.057035:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc082019180 x1875323826475264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448764.057043:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826475264:0@lo:400:kworker.0 00000004:00080000:3.0:1788448764.061581:0:23445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1788448764.062421:0:22690:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788448764.062444:0:22690:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788448764.063954:0:24766:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788448764.063966:0:24766:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788448764.063972:0:24766:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00010000:00080000:0.0:1788448764.078602:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc082018e00 x1875323826475648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448764.078644:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826475648:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788448764.078663:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc082018000 x1875323826475904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448764.078675:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826475904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448764.078689:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826474368:0@lo:400:kworker.0 00010000:00080000:0.0:1788448764.078702:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc082018380 x1875323826475008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448764.078710:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826475008:0@lo:400:kworker.0 00002000:00010000:0.0:1788448764.084157:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448764.084176:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b80540b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.084199:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1788448764.084205:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448764.084213:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b80540b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.084234:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b80540b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.084247:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b80540b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.084267:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b80540b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.084305:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448764.084321:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448764.084328:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b80540b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.084335:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.084340:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b80540b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.084351:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b80540b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.084372:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b80540b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.084381:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b80540b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.084403:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.084405:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.084407:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448764.088736:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448764.088767:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036a2af37/0xf45a9e4e6b805412 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.088788:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1788448764.088803:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448764.088811:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036a2af37/0xf45a9e4e6b805412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.088830:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036a2af37/0xf45a9e4e6b805412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.088841:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036a2af37/0xf45a9e4e6b805412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.088849:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036a2af37/0xf45a9e4e6b805412 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.088872:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448764.088905:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448764.088913:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036a2af37/0xf45a9e4e6b805412 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.088921:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.088926:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036a2af37/0xf45a9e4e6b805412 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.088936:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036a2af37/0xf45a9e4e6b805412 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.088965:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036a2af37/0xf45a9e4e6b805412 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.088973:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036a2af37/0xf45a9e4e6b805412 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.088990:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.088992:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.088995:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.095100:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.095118:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000327853fa/0xf45a9e4e6b805419 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.095139:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.095144:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.095151:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000327853fa/0xf45a9e4e6b805419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.095170:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000327853fa/0xf45a9e4e6b805419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.095193:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000327853fa/0xf45a9e4e6b805419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.095203:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000327853fa/0xf45a9e4e6b805419 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.095232:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448764.096404:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448764.096430:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000327853fa/0xf45a9e4e6b805419 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.096445:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e5000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.096452:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000327853fa/0xf45a9e4e6b805419 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.096464:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000327853fa/0xf45a9e4e6b805419 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.096487:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000327853fa/0xf45a9e4e6b805419 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.096495:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000327853fa/0xf45a9e4e6b805419 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.096555:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.096557:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.096559:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.096958:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.096967:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2f57d4d/0xf45a9e4e6b805420 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.096980:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.096985:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.096991:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2f57d4d/0xf45a9e4e6b805420 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.097016:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2f57d4d/0xf45a9e4e6b805420 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.097026:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2f57d4d/0xf45a9e4e6b805420 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.097035:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2f57d4d/0xf45a9e4e6b805420 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.097054:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448764.097066:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.097071:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2f57d4d/0xf45a9e4e6b805420 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.097079:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e5400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.097082:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2f57d4d/0xf45a9e4e6b805420 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.097090:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2f57d4d/0xf45a9e4e6b805420 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.097101:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2f57d4d/0xf45a9e4e6b805420 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.097109:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2f57d4d/0xf45a9e4e6b805420 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.097134:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.097136:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.097137:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448764.100500:0:23467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00002000:00010000:1.0:1788448764.104187:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448764.104204:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b805427 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.104225:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788448764.104231:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448764.104238:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b805427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.104261:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b805427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.104554:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b805427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.104565:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b805427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.104624:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788448764.108414:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.108431:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b80542e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.108453:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.108459:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.108467:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b80542e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.108485:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b80542e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.108498:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b80542e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.108506:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b80542e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.108701:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448764.108711:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b805427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.108722:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.108728:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b805427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.108738:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b805427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.108763:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b805427 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.108771:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b805427 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.109030:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448764.109035:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b80542e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.109043:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204be00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.109059:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b80542e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.109068:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b80542e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.109080:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b80542e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.109089:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.109091:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.109093:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448764.110504:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.110519:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a6d2215/0xf45a9e4e6b805435 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.110549:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.110555:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.110562:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a6d2215/0xf45a9e4e6b805435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.110579:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a6d2215/0xf45a9e4e6b805435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.110601:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a6d2215/0xf45a9e4e6b805435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.110610:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a6d2215/0xf45a9e4e6b805435 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.110635:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448764.111467:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448764.111479:0:24766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b80542e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.111861:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448764.111871:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a6d2215/0xf45a9e4e6b805435 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.111906:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.111911:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a6d2215/0xf45a9e4e6b805435 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.111922:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a6d2215/0xf45a9e4e6b805435 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.111940:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a6d2215/0xf45a9e4e6b805435 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.111948:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a6d2215/0xf45a9e4e6b805435 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.111973:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.111975:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.111976:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.112004:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.112017:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b80543c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112027:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.112031:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.112037:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b80543c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112048:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b80543c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112055:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b80543c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112062:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b80543c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112084:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448764.112137:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448764.112142:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b80543c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.112150:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.112154:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b80543c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.112162:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b80543c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.112181:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b80543c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.112190:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b80543c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.112204:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.112205:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.112207:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.112551:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.112558:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805443 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112566:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.112570:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.112574:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112584:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112598:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112605:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805443 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112619:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448764.112626:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.112630:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805443 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112636:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204bc00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.112640:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805443 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112647:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805443 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112658:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805443 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112666:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805443 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112679:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.112684:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.112686:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.112936:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.112942:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b80544a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112951:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.112954:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.112958:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b80544a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112968:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b80544a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112975:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b80544a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112983:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b80544a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.112995:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448764.113000:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.113004:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b80544a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113010:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.113014:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b80544a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113031:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b80544a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113041:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b80544a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113048:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b80544a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113061:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.113062:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.113064:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.113384:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.113391:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b805451 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113399:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.113402:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.113406:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b805451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113692:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b805451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113703:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b805451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113717:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b805451 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113732:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448764.113741:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.113744:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b805451 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113751:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.113755:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b805451 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113763:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b805451 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113773:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b805451 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113780:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b805451 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.113794:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.113796:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.113797:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.114376:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.114394:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e19b33a/0xf45a9e4e6b805458 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.114405:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.114408:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.114414:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e19b33a/0xf45a9e4e6b805458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.114570:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e19b33a/0xf45a9e4e6b805458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.114579:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e19b33a/0xf45a9e4e6b805458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.114587:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e19b33a/0xf45a9e4e6b805458 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.114608:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448764.114921:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448764.114929:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e19b33a/0xf45a9e4e6b805458 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.114936:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204ae00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.114940:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e19b33a/0xf45a9e4e6b805458 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.114949:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e19b33a/0xf45a9e4e6b805458 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.114966:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e19b33a/0xf45a9e4e6b805458 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.114973:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e19b33a/0xf45a9e4e6b805458 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.114992:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.114999:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.115001:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448764.115073:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.115079:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8caf74f/0xf45a9e4e6b80545f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.115088:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.115091:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.115095:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8caf74f/0xf45a9e4e6b80545f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.115106:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8caf74f/0xf45a9e4e6b80545f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.115113:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8caf74f/0xf45a9e4e6b80545f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.115120:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8caf74f/0xf45a9e4e6b80545f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.115134:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448764.115556:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448764.115563:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8caf74f/0xf45a9e4e6b80545f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.115583:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.115586:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8caf74f/0xf45a9e4e6b80545f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.115594:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8caf74f/0xf45a9e4e6b80545f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.115606:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8caf74f/0xf45a9e4e6b80545f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.115613:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8caf74f/0xf45a9e4e6b80545f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.115854:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.115857:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.115858:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.117125:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.117868:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.117893:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b805466 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.117912:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.117917:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.117924:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b805466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.117938:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b805466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.117955:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b805466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.117963:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b805466 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.117988:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448764.118406:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448764.118415:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b805466 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.118425:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204be00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.118429:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b805466 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.118446:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b805466 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.118466:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b805466 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.118474:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daf22adf/0xf45a9e4e6b805466 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.118493:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.118495:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.118497:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448764.120040:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.120057:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029be274e/0xf45a9e4e6b80546d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.120074:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.120079:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.120085:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029be274e/0xf45a9e4e6b80546d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.120098:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029be274e/0xf45a9e4e6b80546d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.120107:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029be274e/0xf45a9e4e6b80546d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.120121:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029be274e/0xf45a9e4e6b80546d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.120142:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788448764.120687:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.120696:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000850820e9/0xf45a9e4e6b805474 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.120706:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.120710:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.120713:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000850820e9/0xf45a9e4e6b805474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.120724:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000850820e9/0xf45a9e4e6b805474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.120733:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000850820e9/0xf45a9e4e6b805474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.120740:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000850820e9/0xf45a9e4e6b805474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.120771:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788448764.121460:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448764.121470:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029be274e/0xf45a9e4e6b80546d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121481:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.121485:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029be274e/0xf45a9e4e6b80546d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121495:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029be274e/0xf45a9e4e6b80546d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121514:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029be274e/0xf45a9e4e6b80546d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121522:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029be274e/0xf45a9e4e6b80546d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448764.121551:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.121552:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448764.121556:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000850820e9/0xf45a9e4e6b805474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.121558:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b80547b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.121568:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.121572:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.121576:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204a600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.121577:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b80547b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121580:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000850820e9/0xf45a9e4e6b805474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121588:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000850820e9/0xf45a9e4e6b805474 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.121589:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b80547b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.121598:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b80547b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121601:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000850820e9/0xf45a9e4e6b805474 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.121608:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b80547b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121609:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000850820e9/0xf45a9e4e6b805474 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.121617:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448764.121622:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448764.121624:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b80547b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121630:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.121633:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b80547b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121640:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b80547b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121650:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b80547b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121662:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000940d7246/0xf45a9e4e6b80547b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.121675:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.121677:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.121679:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.121686:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.122046:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.122053:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b805482 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.122062:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.122072:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.122077:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b805482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.122087:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b805482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.122096:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b805482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.122104:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b805482 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.122122:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788448764.122635:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.122643:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805489 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.122652:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.122655:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.122659:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805489 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.122669:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805489 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.122677:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805489 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.122692:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805489 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.122710:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788448764.122997:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.123005:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f3377ef/0xf45a9e4e6b805490 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.123014:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.123016:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.123020:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f3377ef/0xf45a9e4e6b805490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.123028:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f3377ef/0xf45a9e4e6b805490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.123036:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f3377ef/0xf45a9e4e6b805490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.123044:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f3377ef/0xf45a9e4e6b805490 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.123064:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788448764.123669:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.123679:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085281ba1/0xf45a9e4e6b805497 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.123695:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.123698:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.123703:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085281ba1/0xf45a9e4e6b805497 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.123714:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085281ba1/0xf45a9e4e6b805497 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.123722:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085281ba1/0xf45a9e4e6b805497 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.123730:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085281ba1/0xf45a9e4e6b805497 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.123740:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788448764.124229:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.124251:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a4fbf1c/0xf45a9e4e6b80549e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.124261:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.124265:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.124269:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a4fbf1c/0xf45a9e4e6b80549e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.124280:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a4fbf1c/0xf45a9e4e6b80549e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.124301:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a4fbf1c/0xf45a9e4e6b80549e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.124309:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a4fbf1c/0xf45a9e4e6b80549e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.124318:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788448764.124690:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788448764.124699:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b805482 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.124708:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.124713:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b805482 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.124723:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b805482 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448764.124739:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.124741:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b805482 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.124745:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b8054a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.124749:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b805482 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.124754:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.124757:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.124761:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b8054a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.124768:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788448764.124771:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b8054a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.124773:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805489 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.124778:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b8054a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.124786:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204bc00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.124787:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b8054a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.124790:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805489 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.124805:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788448764.124989:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.124995:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b8054ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125004:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.125006:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.125010:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b8054ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125018:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b8054ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125025:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b8054ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125031:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b8054ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125038:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788448764.125456:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.125463:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b8054b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125472:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.125481:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.125485:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b8054b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125495:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b8054b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125502:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b8054b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125509:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b8054b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125517:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788448764.125661:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.125667:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8fff86/0xf45a9e4e6b8054ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125676:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.125679:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.125683:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8fff86/0xf45a9e4e6b8054ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125692:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8fff86/0xf45a9e4e6b8054ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125699:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8fff86/0xf45a9e4e6b8054ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125711:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8fff86/0xf45a9e4e6b8054ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.125720:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1788448764.125900:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805489 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.125915:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805489 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.125924:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b805489 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.125944:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788448764.125949:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f3377ef/0xf45a9e4e6b805490 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.125956:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204aa00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.125960:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f3377ef/0xf45a9e4e6b805490 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.125967:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f3377ef/0xf45a9e4e6b805490 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.125977:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f3377ef/0xf45a9e4e6b805490 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.125993:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f3377ef/0xf45a9e4e6b805490 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126009:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788448764.126012:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085281ba1/0xf45a9e4e6b805497 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126019:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204ba00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.126022:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085281ba1/0xf45a9e4e6b805497 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126030:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085281ba1/0xf45a9e4e6b805497 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126039:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085281ba1/0xf45a9e4e6b805497 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126047:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085281ba1/0xf45a9e4e6b805497 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126060:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788448764.126063:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a4fbf1c/0xf45a9e4e6b80549e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126069:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.126078:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a4fbf1c/0xf45a9e4e6b80549e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126087:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a4fbf1c/0xf45a9e4e6b80549e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126096:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a4fbf1c/0xf45a9e4e6b80549e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126103:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a4fbf1c/0xf45a9e4e6b80549e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126116:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788448764.126120:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b8054a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126127:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204a400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.126130:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b8054a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126137:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b8054a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126147:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b8054a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126154:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b8054a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126182:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00010000:2.0:1788448764.126182:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.126187:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b8054ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126188:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f09a3d7/0xf45a9e4e6b8054c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126195:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.126197:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.126198:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b8054ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126200:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.126205:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f09a3d7/0xf45a9e4e6b8054c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126207:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b8054ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126214:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f09a3d7/0xf45a9e4e6b8054c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126217:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b8054ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126222:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f09a3d7/0xf45a9e4e6b8054c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126225:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e90c4da9/0xf45a9e4e6b8054ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126231:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f09a3d7/0xf45a9e4e6b8054c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126236:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448764.126239:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b8054b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126245:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204ae00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.126249:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b8054b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.126268:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b8054b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126337:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788448764.126476:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.126481:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fd6ddf7/0xf45a9e4e6b8054c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126496:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.126499:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.126503:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fd6ddf7/0xf45a9e4e6b8054c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126512:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fd6ddf7/0xf45a9e4e6b8054c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126521:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fd6ddf7/0xf45a9e4e6b8054c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126528:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fd6ddf7/0xf45a9e4e6b8054c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126536:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788448764.126896:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.126902:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f62a5df/0xf45a9e4e6b8054cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126910:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.126913:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.126917:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f62a5df/0xf45a9e4e6b8054cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126925:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f62a5df/0xf45a9e4e6b8054cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126943:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f62a5df/0xf45a9e4e6b8054cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126949:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f62a5df/0xf45a9e4e6b8054cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.126957:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788448764.127095:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.127101:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a13cbc3/0xf45a9e4e6b8054d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.127110:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.127113:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.127118:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a13cbc3/0xf45a9e4e6b8054d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.127127:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a13cbc3/0xf45a9e4e6b8054d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.127134:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a13cbc3/0xf45a9e4e6b8054d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.127141:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a13cbc3/0xf45a9e4e6b8054d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.127159:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788448764.127461:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.127467:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc83ff2/0xf45a9e4e6b8054dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.127475:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.127477:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.127481:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc83ff2/0xf45a9e4e6b8054dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.127489:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfc83ff2/0xf45a9e4e6b8054dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.127496:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc83ff2/0xf45a9e4e6b8054dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.127502:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc83ff2/0xf45a9e4e6b8054dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.127510:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788448764.127988:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.127995:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b31802c/0xf45a9e4e6b8054e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.128004:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.128013:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.128017:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b31802c/0xf45a9e4e6b8054e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.128027:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b31802c/0xf45a9e4e6b8054e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.128035:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b31802c/0xf45a9e4e6b8054e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.128042:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b31802c/0xf45a9e4e6b8054e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.128050:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1788448764.128056:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b8054b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128065:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b8054b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128085:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788448764.128089:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8fff86/0xf45a9e4e6b8054ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128097:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375e00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.128100:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8fff86/0xf45a9e4e6b8054ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128109:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8fff86/0xf45a9e4e6b8054ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128120:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8fff86/0xf45a9e4e6b8054ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128128:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8fff86/0xf45a9e4e6b8054ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128153:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788448764.128157:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f09a3d7/0xf45a9e4e6b8054c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128164:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e374a00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.128168:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f09a3d7/0xf45a9e4e6b8054c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128176:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f09a3d7/0xf45a9e4e6b8054c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128186:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f09a3d7/0xf45a9e4e6b8054c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128193:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f09a3d7/0xf45a9e4e6b8054c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128205:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788448764.128209:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fd6ddf7/0xf45a9e4e6b8054c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128216:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e374600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.128219:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fd6ddf7/0xf45a9e4e6b8054c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128237:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fd6ddf7/0xf45a9e4e6b8054c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128249:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fd6ddf7/0xf45a9e4e6b8054c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128256:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fd6ddf7/0xf45a9e4e6b8054c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128269:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788448764.128284:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f62a5df/0xf45a9e4e6b8054cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128292:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375c00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.128295:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f62a5df/0xf45a9e4e6b8054cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128303:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f62a5df/0xf45a9e4e6b8054cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128313:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f62a5df/0xf45a9e4e6b8054cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128320:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f62a5df/0xf45a9e4e6b8054cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128348:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788448764.128352:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a13cbc3/0xf45a9e4e6b8054d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128358:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e374800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.128361:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a13cbc3/0xf45a9e4e6b8054d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128369:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a13cbc3/0xf45a9e4e6b8054d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128380:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a13cbc3/0xf45a9e4e6b8054d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128387:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a13cbc3/0xf45a9e4e6b8054d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128400:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448764.128403:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfc83ff2/0xf45a9e4e6b8054dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128409:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e374200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.128413:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc83ff2/0xf45a9e4e6b8054dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128432:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc83ff2/0xf45a9e4e6b8054dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128443:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfc83ff2/0xf45a9e4e6b8054dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128451:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfc83ff2/0xf45a9e4e6b8054dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128464:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448764.128468:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b31802c/0xf45a9e4e6b8054e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128474:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e374000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.128478:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b31802c/0xf45a9e4e6b8054e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128485:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b31802c/0xf45a9e4e6b8054e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128494:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b31802c/0xf45a9e4e6b8054e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448764.128497:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.128502:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b31802c/0xf45a9e4e6b8054e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.128503:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f45201c/0xf45a9e4e6b8054eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.128512:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.128515:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.128519:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f45201c/0xf45a9e4e6b8054eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128525:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.128526:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.128528:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.128528:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f45201c/0xf45a9e4e6b8054eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.128536:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f45201c/0xf45a9e4e6b8054eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.128537:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.128560:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f45201c/0xf45a9e4e6b8054eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.128579:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788448764.129005:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.129012:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36ed59f/0xf45a9e4e6b8054f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.129021:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.129024:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.129029:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f36ed59f/0xf45a9e4e6b8054f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.129038:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f36ed59f/0xf45a9e4e6b8054f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.129045:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36ed59f/0xf45a9e4e6b8054f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.129052:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f36ed59f/0xf45a9e4e6b8054f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.129064:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788448764.129985:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448764.129997:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f45201c/0xf45a9e4e6b8054eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.130009:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.130014:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f45201c/0xf45a9e4e6b8054eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.130024:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f45201c/0xf45a9e4e6b8054eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.130042:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f45201c/0xf45a9e4e6b8054eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.130049:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f45201c/0xf45a9e4e6b8054eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.130069:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448764.130073:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f36ed59f/0xf45a9e4e6b8054f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.130080:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.130090:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36ed59f/0xf45a9e4e6b8054f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.130098:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36ed59f/0xf45a9e4e6b8054f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.130107:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f36ed59f/0xf45a9e4e6b8054f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.130114:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f36ed59f/0xf45a9e4e6b8054f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.130126:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.130127:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.130129:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.130138:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.130561:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.130572:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032291f98/0xf45a9e4e6b8054f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.130590:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.130594:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.130601:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032291f98/0xf45a9e4e6b8054f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.130614:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032291f98/0xf45a9e4e6b8054f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.130624:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032291f98/0xf45a9e4e6b8054f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.130634:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032291f98/0xf45a9e4e6b8054f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.130662:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788448764.132471:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.132485:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003232e40d/0xf45a9e4e6b805500 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.132503:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.132507:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.132513:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003232e40d/0xf45a9e4e6b805500 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.132527:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003232e40d/0xf45a9e4e6b805500 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.132558:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003232e40d/0xf45a9e4e6b805500 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.132566:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003232e40d/0xf45a9e4e6b805500 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.132592:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788448764.132843:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.132849:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e22508/0xf45a9e4e6b805507 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.132859:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.132862:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.132866:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e22508/0xf45a9e4e6b805507 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.132876:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2e22508/0xf45a9e4e6b805507 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.132905:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2e22508/0xf45a9e4e6b805507 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.132913:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2e22508/0xf45a9e4e6b805507 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.132935:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788448764.133969:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788448764.133982:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032291f98/0xf45a9e4e6b8054f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.133994:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.133999:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032291f98/0xf45a9e4e6b8054f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134011:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032291f98/0xf45a9e4e6b8054f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134032:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032291f98/0xf45a9e4e6b8054f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134049:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032291f98/0xf45a9e4e6b8054f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134072:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448764.134076:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003232e40d/0xf45a9e4e6b805500 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134082:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e374c00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.134086:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003232e40d/0xf45a9e4e6b805500 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134093:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003232e40d/0xf45a9e4e6b805500 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134103:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003232e40d/0xf45a9e4e6b805500 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134111:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003232e40d/0xf45a9e4e6b805500 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134125:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448764.134129:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2e22508/0xf45a9e4e6b805507 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134136:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e374400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.134145:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e22508/0xf45a9e4e6b805507 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134153:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2e22508/0xf45a9e4e6b805507 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134165:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2e22508/0xf45a9e4e6b805507 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134172:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2e22508/0xf45a9e4e6b805507 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.134187:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.134189:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.134190:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448764.134390:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.135121:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.135133:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad5dced/0xf45a9e4e6b80550e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.135147:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.135152:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.135158:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ad5dced/0xf45a9e4e6b80550e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.135172:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ad5dced/0xf45a9e4e6b80550e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.135196:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad5dced/0xf45a9e4e6b80550e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.135205:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ad5dced/0xf45a9e4e6b80550e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.135226:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788448764.136058:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.136069:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049dac055/0xf45a9e4e6b805515 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136080:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.136083:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.136088:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049dac055/0xf45a9e4e6b805515 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136100:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049dac055/0xf45a9e4e6b805515 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136109:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049dac055/0xf45a9e4e6b805515 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136126:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049dac055/0xf45a9e4e6b805515 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136146:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788448764.136157:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448764.136163:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ad5dced/0xf45a9e4e6b80550e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136171:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e374e00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.136176:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad5dced/0xf45a9e4e6b80550e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136185:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad5dced/0xf45a9e4e6b80550e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136202:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ad5dced/0xf45a9e4e6b80550e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136210:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ad5dced/0xf45a9e4e6b80550e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136235:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448764.136238:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049dac055/0xf45a9e4e6b805515 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136257:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448764.136261:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049dac055/0xf45a9e4e6b805515 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136268:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049dac055/0xf45a9e4e6b805515 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136292:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049dac055/0xf45a9e4e6b805515 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136300:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049dac055/0xf45a9e4e6b805515 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.136314:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.136316:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.136318:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448764.136899:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.136933:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.136941:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006688b8d2/0xf45a9e4e6b80551c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.136950:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.136959:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.136965:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006688b8d2/0xf45a9e4e6b80551c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.136976:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006688b8d2/0xf45a9e4e6b80551c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.136986:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006688b8d2/0xf45a9e4e6b80551c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.136993:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006688b8d2/0xf45a9e4e6b80551c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.137008:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788448764.137396:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.137400:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.137403:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1284ef9/0xf45a9e4e6b805523 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.137405:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006688b8d2/0xf45a9e4e6b80551c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.137413:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375a00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.137413:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.137416:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.137417:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006688b8d2/0xf45a9e4e6b80551c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.137426:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006688b8d2/0xf45a9e4e6b80551c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.137432:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1284ef9/0xf45a9e4e6b805523 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.137442:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1284ef9/0xf45a9e4e6b805523 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.137448:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006688b8d2/0xf45a9e4e6b80551c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.137450:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1284ef9/0xf45a9e4e6b805523 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.137455:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006688b8d2/0xf45a9e4e6b80551c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.137462:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1284ef9/0xf45a9e4e6b805523 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.137473:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448764.137477:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1284ef9/0xf45a9e4e6b805523 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.137477:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788448764.137484:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.137484:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.137488:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1284ef9/0xf45a9e4e6b805523 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.137495:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1284ef9/0xf45a9e4e6b805523 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.137504:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1284ef9/0xf45a9e4e6b805523 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.137511:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1284ef9/0xf45a9e4e6b805523 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.137523:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.137524:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.137531:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448764.137620:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448764.137627:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b80552a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.137641:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788448764.137644:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448764.137649:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b80552a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.137660:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b80552a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.137668:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b80552a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.137675:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b80552a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.137697:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448764.137760:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.137766:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b80552a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.137774:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fdc00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.137777:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b80552a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.137786:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b80552a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.137797:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b80552a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.137804:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b80552a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.137820:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.137821:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.137823:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448764.138197:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.138205:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067e8ead6/0xf45a9e4e6b805531 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.138214:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.138217:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.138221:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067e8ead6/0xf45a9e4e6b805531 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.138232:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067e8ead6/0xf45a9e4e6b805531 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.138239:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067e8ead6/0xf45a9e4e6b805531 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.138247:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067e8ead6/0xf45a9e4e6b805531 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.138374:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788448764.138700:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.138707:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b903370d/0xf45a9e4e6b805538 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.138717:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.138720:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.138724:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b903370d/0xf45a9e4e6b805538 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.138745:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b903370d/0xf45a9e4e6b805538 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.138753:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b903370d/0xf45a9e4e6b805538 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.138759:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b903370d/0xf45a9e4e6b805538 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142087:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788448764.142107:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067e8ead6/0xf45a9e4e6b805531 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142123:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448764.142129:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067e8ead6/0xf45a9e4e6b805531 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142141:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067e8ead6/0xf45a9e4e6b805531 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142202:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067e8ead6/0xf45a9e4e6b805531 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142210:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067e8ead6/0xf45a9e4e6b805531 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142237:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448764.142242:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b903370d/0xf45a9e4e6b805538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142248:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448764.142251:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b903370d/0xf45a9e4e6b805538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142258:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b903370d/0xf45a9e4e6b805538 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142266:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b903370d/0xf45a9e4e6b805538 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142283:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448764.142284:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448764.142286:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.142335:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.142345:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117c0936/0xf45a9e4e6b80553f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.142360:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.142366:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.142373:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117c0936/0xf45a9e4e6b80553f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.142387:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000117c0936/0xf45a9e4e6b80553f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.142397:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117c0936/0xf45a9e4e6b80553f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.142404:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000117c0936/0xf45a9e4e6b80553f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.142430:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448764.142603:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448764.142610:0:24219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b903370d/0xf45a9e4e6b805538 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142781:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448764.142787:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000117c0936/0xf45a9e4e6b80553f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142817:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448764.142820:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000117c0936/0xf45a9e4e6b80553f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142828:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000117c0936/0xf45a9e4e6b80553f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142841:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000117c0936/0xf45a9e4e6b80553f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142848:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000117c0936/0xf45a9e4e6b80553f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448764.142865:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448764.142867:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448764.142869:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448764.142874:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448764.143493:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1788448764.143493:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.143504:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070d62566/0xf45a9e4e6b80554d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.143505:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000694105e7/0xf45a9e4e6b805546 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.143517:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.143517:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.143522:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.143522:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.143528:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070d62566/0xf45a9e4e6b80554d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.143528:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000694105e7/0xf45a9e4e6b805546 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.143552:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070d62566/0xf45a9e4e6b80554d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.143562:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000694105e7/0xf45a9e4e6b805546 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.143573:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000694105e7/0xf45a9e4e6b805546 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.143574:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070d62566/0xf45a9e4e6b80554d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.143582:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070d62566/0xf45a9e4e6b80554d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.143582:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000694105e7/0xf45a9e4e6b805546 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.143629:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788448764.144085:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.144093:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004468a038/0xf45a9e4e6b805554 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.144101:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.144104:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.144108:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004468a038/0xf45a9e4e6b805554 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.144118:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004468a038/0xf45a9e4e6b805554 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.144126:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004468a038/0xf45a9e4e6b805554 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.144133:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004468a038/0xf45a9e4e6b805554 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147656:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788448764.147662:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788448764.147691:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788448764.147701:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070d62566/0xf45a9e4e6b80554d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147717:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.147722:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070d62566/0xf45a9e4e6b80554d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147734:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070d62566/0xf45a9e4e6b80554d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147757:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070d62566/0xf45a9e4e6b80554d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147764:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070d62566/0xf45a9e4e6b80554d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147811:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448764.147816:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000694105e7/0xf45a9e4e6b805546 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147823:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.147826:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000694105e7/0xf45a9e4e6b805546 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147835:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000694105e7/0xf45a9e4e6b805546 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147846:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000694105e7/0xf45a9e4e6b805546 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147854:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000694105e7/0xf45a9e4e6b805546 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147871:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.147874:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004468a038/0xf45a9e4e6b805554 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147893:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9a00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.147896:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004468a038/0xf45a9e4e6b805554 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147914:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004468a038/0xf45a9e4e6b805554 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147923:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004468a038/0xf45a9e4e6b805554 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147930:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004468a038/0xf45a9e4e6b805554 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.147942:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.147944:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.147946:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448764.148608:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.149077:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.149087:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d607558c/0xf45a9e4e6b80555b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.149104:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.149108:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.149115:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d607558c/0xf45a9e4e6b80555b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.149127:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d607558c/0xf45a9e4e6b80555b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.149136:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d607558c/0xf45a9e4e6b80555b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.149150:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d607558c/0xf45a9e4e6b80555b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.149515:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788448764.151574:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.151590:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805562 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151608:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.151613:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.151620:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805562 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151634:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805562 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151645:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805562 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151653:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805562 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151677:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788448764.151689:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448764.151695:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d607558c/0xf45a9e4e6b80555b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151715:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.151720:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d607558c/0xf45a9e4e6b80555b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151729:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d607558c/0xf45a9e4e6b80555b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151747:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d607558c/0xf45a9e4e6b80555b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151754:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d607558c/0xf45a9e4e6b80555b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151772:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.151775:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805562 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151782:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.151785:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805562 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151792:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805562 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151801:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805562 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151816:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805562 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.151829:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.151831:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.151833:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.152654:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.152665:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5ce694/0xf45a9e4e6b805569 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.152677:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.152681:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.152687:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e5ce694/0xf45a9e4e6b805569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.152698:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e5ce694/0xf45a9e4e6b805569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.152708:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e5ce694/0xf45a9e4e6b805569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.152715:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e5ce694/0xf45a9e4e6b805569 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.152732:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448764.152741:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.152752:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e5ce694/0xf45a9e4e6b805569 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.152760:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5254c00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.152764:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5ce694/0xf45a9e4e6b805569 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.152772:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e5ce694/0xf45a9e4e6b805569 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.152785:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e5ce694/0xf45a9e4e6b805569 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.152791:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e5ce694/0xf45a9e4e6b805569 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.152807:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.152808:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.152810:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.153601:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.153861:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.153871:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d58a54a9/0xf45a9e4e6b805570 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.153903:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.153907:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.153913:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d58a54a9/0xf45a9e4e6b805570 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.153941:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d58a54a9/0xf45a9e4e6b805570 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.153950:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d58a54a9/0xf45a9e4e6b805570 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.153957:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d58a54a9/0xf45a9e4e6b805570 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.153974:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448764.153984:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.153988:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d58a54a9/0xf45a9e4e6b805570 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.153996:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5254400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.154000:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d58a54a9/0xf45a9e4e6b805570 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.154009:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d58a54a9/0xf45a9e4e6b805570 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.154023:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d58a54a9/0xf45a9e4e6b805570 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.154031:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d58a54a9/0xf45a9e4e6b805570 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.154057:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.154059:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.154061:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448764.154424:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.154431:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8caf74f/0xf45a9e4e6b805577 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.154441:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.154445:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.154449:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8caf74f/0xf45a9e4e6b805577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.154460:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8caf74f/0xf45a9e4e6b805577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.154468:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8caf74f/0xf45a9e4e6b805577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.154476:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8caf74f/0xf45a9e4e6b805577 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.154497:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448764.154528:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.154533:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8caf74f/0xf45a9e4e6b805577 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.154552:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.154556:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8caf74f/0xf45a9e4e6b805577 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.154564:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8caf74f/0xf45a9e4e6b805577 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.154577:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8caf74f/0xf45a9e4e6b805577 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.154585:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8caf74f/0xf45a9e4e6b805577 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.154600:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.154602:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.154604:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.154989:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.154996:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d4f8d0/0xf45a9e4e6b80557e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448764.155007:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.155012:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a6d2215/0xf45a9e4e6b805585 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.155017:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.155019:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.155020:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.155025:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d4f8d0/0xf45a9e4e6b80557e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.155026:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.155031:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a6d2215/0xf45a9e4e6b805585 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.155036:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d4f8d0/0xf45a9e4e6b80557e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.155040:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a6d2215/0xf45a9e4e6b805585 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.155044:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092d4f8d0/0xf45a9e4e6b80557e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.155047:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a6d2215/0xf45a9e4e6b805585 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.155052:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092d4f8d0/0xf45a9e4e6b80557e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.155055:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a6d2215/0xf45a9e4e6b805585 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.155067:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788448764.160745:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448764.160763:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092d4f8d0/0xf45a9e4e6b80557e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.160782:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5254e00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.160788:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d4f8d0/0xf45a9e4e6b80557e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.160802:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d4f8d0/0xf45a9e4e6b80557e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.160858:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092d4f8d0/0xf45a9e4e6b80557e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.160865:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d4f8d0/0xf45a9e4e6b80557e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.160911:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.160917:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a6d2215/0xf45a9e4e6b805585 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.160925:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.160929:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a6d2215/0xf45a9e4e6b805585 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.160938:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a6d2215/0xf45a9e4e6b805585 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.160949:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a6d2215/0xf45a9e4e6b805585 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.160958:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.160961:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.160963:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.161009:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448764.165918:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788448764.165938:0:24766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a6d2215/0xf45a9e4e6b805585 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448764.167186:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.167202:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029be274e/0xf45a9e4e6b80558c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.167220:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.167226:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.167233:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029be274e/0xf45a9e4e6b80558c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.167249:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029be274e/0xf45a9e4e6b80558c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.167269:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029be274e/0xf45a9e4e6b80558c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.167765:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029be274e/0xf45a9e4e6b80558c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448764.169404:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.169418:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4b4e0e/0xf45a9e4e6b805593 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.169449:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.169455:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.169462:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4b4e0e/0xf45a9e4e6b805593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.169477:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad4b4e0e/0xf45a9e4e6b805593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.169488:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4b4e0e/0xf45a9e4e6b805593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.169496:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4b4e0e/0xf45a9e4e6b805593 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.169896:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788448764.172094:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448764.172113:0:24766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b31802c/0xf45a9e4e6b80559a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.172133:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788448764.172138:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448764.172145:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b31802c/0xf45a9e4e6b80559a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.172159:0:24766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b31802c/0xf45a9e4e6b80559a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.173098:0:24766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b31802c/0xf45a9e4e6b80559a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.173110:0:24766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b31802c/0xf45a9e4e6b80559a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173469:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788448764.173497:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788448764.173508:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029be274e/0xf45a9e4e6b80558c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173518:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.173524:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029be274e/0xf45a9e4e6b80558c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173534:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029be274e/0xf45a9e4e6b80558c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173585:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029be274e/0xf45a9e4e6b80558c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173592:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029be274e/0xf45a9e4e6b80558c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173622:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448764.173626:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad4b4e0e/0xf45a9e4e6b805593 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173634:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255a00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.173637:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4b4e0e/0xf45a9e4e6b805593 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173645:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4b4e0e/0xf45a9e4e6b805593 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173656:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad4b4e0e/0xf45a9e4e6b805593 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173663:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad4b4e0e/0xf45a9e4e6b805593 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173682:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.173685:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b31802c/0xf45a9e4e6b80559a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173698:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e374000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.173702:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b31802c/0xf45a9e4e6b80559a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173710:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b31802c/0xf45a9e4e6b80559a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173721:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b31802c/0xf45a9e4e6b80559a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.173730:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.173731:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.173734:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.176601:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.176619:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9997e2b/0xf45a9e4e6b8055a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.176641:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.176646:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.176653:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9997e2b/0xf45a9e4e6b8055a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.176669:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9997e2b/0xf45a9e4e6b8055a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.176680:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9997e2b/0xf45a9e4e6b8055a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.176693:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9997e2b/0xf45a9e4e6b8055a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.176711:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448764.177131:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448764.177140:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9997e2b/0xf45a9e4e6b8055a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.177149:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448764.177155:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9997e2b/0xf45a9e4e6b8055a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.177234:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9997e2b/0xf45a9e4e6b8055a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.177319:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9997e2b/0xf45a9e4e6b8055a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.177328:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9997e2b/0xf45a9e4e6b8055a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.177353:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.177356:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.177358:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448764.178802:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.178828:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ae951ca/0xf45a9e4e6b8055a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.178847:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.178852:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.178859:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ae951ca/0xf45a9e4e6b8055a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.178872:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ae951ca/0xf45a9e4e6b8055a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.178912:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ae951ca/0xf45a9e4e6b8055a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.178921:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ae951ca/0xf45a9e4e6b8055a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.178939:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788448764.179620:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.179630:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a74f7718/0xf45a9e4e6b8055af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.179641:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.179644:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.179648:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a74f7718/0xf45a9e4e6b8055af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.179658:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a74f7718/0xf45a9e4e6b8055af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.179673:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a74f7718/0xf45a9e4e6b8055af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.179681:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a74f7718/0xf45a9e4e6b8055af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.179691:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788448764.180002:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.180009:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007d0df3/0xf45a9e4e6b8055b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.180017:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.180020:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.180025:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000007d0df3/0xf45a9e4e6b8055b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.180034:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000007d0df3/0xf45a9e4e6b8055b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.180042:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007d0df3/0xf45a9e4e6b8055b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.180050:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000007d0df3/0xf45a9e4e6b8055b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.180070:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788448764.180675:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448764.180686:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf1f1f54/0xf45a9e4e6b8055bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.180699:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788448764.180703:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448764.180707:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf1f1f54/0xf45a9e4e6b8055bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.180718:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf1f1f54/0xf45a9e4e6b8055bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.180726:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf1f1f54/0xf45a9e4e6b8055bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.180735:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf1f1f54/0xf45a9e4e6b8055bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448764.180745:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:2.0:1788448764.181361:0:24219:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1788448764.181625:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22737:x1875323826475776:12345-0@lo:5:osp-pre-1-0.0 Request processed in 129899us (131089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448764.181637:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448764.181682:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448764.181704:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23457:x1875323826476032:12345-0@lo:7:osp-pre-1-1.0 00010000:00010000:0.0:1788448764.182390:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788448764.182404:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ae951ca/0xf45a9e4e6b8055a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.182417:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.182423:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ae951ca/0xf45a9e4e6b8055a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.182437:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ae951ca/0xf45a9e4e6b8055a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.182473:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ae951ca/0xf45a9e4e6b8055a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.182482:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ae951ca/0xf45a9e4e6b8055a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448764.182579:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22737:1875323826475776:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788448764.182596:0:22737:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788448764.182657:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22737:1875323826476160:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788448764.182718:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.182753:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448764.182776:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788448764.182784:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:0.0:1788448764.182974:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788448764.182983:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a74f7718/0xf45a9e4e6b8055af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.182992:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255e00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.182996:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a74f7718/0xf45a9e4e6b8055af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183005:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a74f7718/0xf45a9e4e6b8055af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183029:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a74f7718/0xf45a9e4e6b8055af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183038:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a74f7718/0xf45a9e4e6b8055af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183055:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448764.183059:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000007d0df3/0xf45a9e4e6b8055b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183065:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5254a00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.183068:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000007d0df3/0xf45a9e4e6b8055b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183074:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000007d0df3/0xf45a9e4e6b8055b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183083:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000007d0df3/0xf45a9e4e6b8055b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183090:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000007d0df3/0xf45a9e4e6b8055b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183102:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448764.183105:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf1f1f54/0xf45a9e4e6b8055bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183118:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5254600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448764.183121:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf1f1f54/0xf45a9e4e6b8055bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183129:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf1f1f54/0xf45a9e4e6b8055bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183140:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf1f1f54/0xf45a9e4e6b8055bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183147:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf1f1f54/0xf45a9e4e6b8055bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448764.183159:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.183161:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448764.183164:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448764.184905:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826476160 00000100:00100000:0.0:1788448764.184920:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826476160 00000100:00100000:0.0:1788448764.185088:0:25164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788448764.185101:0:25164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22737:x1875323826476160:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788448764.185153:0:25164:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:3.0:1788448764.186050:0:24766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788448764.186066:0:24766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b31802c/0xf45a9e4e6b80559a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448764.186130:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448764.186455:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788448764.187047:0:24766:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:3.0:1788448764.187167:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22735:x1875323826475520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 135937us (136760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448764.187178:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448764.188234:0:22735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22735:1875323826475520:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788448764.188259:0:22735:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:0.0:1788448764.188935:0:22735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22735:1875323826476288:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788448764.189017:0:22735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.189049:0:22735:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448764.189073:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826476288 00000100:00100000:0.0:1788448764.189080:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826476288 00000100:00100000:0.0:1788448764.189134:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788448764.189144:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22735:x1875323826476288:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788448764.189948:0:24221:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00080000:2.0:1788448764.192462:0:24219:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788448764.192476:0:24219:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788448764.192609:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23457:x1875323826476032:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10904us (141604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448764.192621:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448764.193013:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875323826476032:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788448764.193033:0:23457:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788448764.193100:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875323826476416:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788448764.193144:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448764.193184:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1887226c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448764.193206:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826476416 00000100:00100000:3.0:1788448764.193213:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826476416 00000100:00100000:3.0:1788448764.193266:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448764.193745:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23457:x1875323826476416:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788448764.193779:0:24220:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788448764.193935:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23457:x1875323826476416:12345-0@lo:5:osp-pre-1-1.0 Request processed in 660us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448764.193944:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448764.193982:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875323826476416:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788448764.193992:0:23457:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788448764.194028:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875323826476544:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788448764.194055:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448764.194074:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1887226c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448764.194088:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826476544 00000100:00100000:3.0:1788448764.194093:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826476544 00000100:00100000:3.0:1788448764.194120:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788448764.194127:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23457:x1875323826476544:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788448764.194153:0:24220:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000001:00080000:1.0:1788448764.236908:0:25033:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1788448764.236978:0:25033:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788448764.236984:0:25033:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788448764.238202:0:25164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22737:x1875323826476160:12345-0@lo:5:osp-pre-1-0.0 Request processed in 53095us (55475us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788448764.238217:0:25164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788448764.238291:0:22737:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788448764.238301:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22737:1875323826476160:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788448764.238323:0:22737:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:0.0:1788448764.253699:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23457:x1875323826476544:12345-0@lo:5:osp-pre-1-1.0 Request processed in 59561us (59631us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788448764.253715:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448764.253786:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b6563480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875323826476544:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788448764.253805:0:23457:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788448764.253862:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23457:1875323826476672:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788448764.253929:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448764.253969:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448764.254012:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826476672 00000100:00100000:1.0:1788448764.254020:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826476672 00000100:00100000:1.0:1788448764.254075:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448764.254085:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1875323826476672:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788448764.254144:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1875323826476672:12345-0@lo:900:osp-pre-1-1.0 Request processed in 60us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448764.254159:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788448764.254392:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e8000 x1875323826476672/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788448780 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448764.254404:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23457:1875323826476672:0@lo:900:osp-pre-1-1.0 00000001:00080000:2.0:1788448764.256074:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788448764.256140:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788448764.256742:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22735:x1875323826476288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 67592us (67718us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788448764.256756:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788448764.257937:0:22735:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788448764.257951:0:22735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22735:1875323826476288:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788448764.257970:0:22735:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1788448764.351293:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448765.375101:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448766.399678:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448767.421972:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448767.679088:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448767.679109:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826476800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448767.679176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448767.679224:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826476800 00000100:00100000:1.0:1788448767.679232:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826476800 00000100:00100000:1.0:1788448767.679283:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448767.679294:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826476800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448767.679321:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788448767.679364:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826476800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448767.679371:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788448767.679391:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448767.679427:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826476800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448768.190336:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826476928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448768.190727:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448768.190815:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826476928 00000100:00100000:0.0:1788448768.190825:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826476928 00000100:00100000:0.0:1788448768.190876:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448768.190906:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826476928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448768.192189:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788448768.192285:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826476928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1378us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448768.192296:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448768.192366:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826476928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448768.193566:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448768.193585:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826477056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448768.195299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448768.195495:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826477056 00000100:00100000:1.0:1788448768.195507:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826477056 00000100:00100000:1.0:1788448768.195789:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788448768.195802:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826477056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448768.195850:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788448768.196160:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826477056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 360us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448768.196168:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788448768.196394:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826477056:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788448768.448652:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788448768.701840:0:25390:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788448769.214575:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826477184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448769.214671:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.214721:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826477696:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.214743:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.214777:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826478208:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.214795:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.214809:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826478720:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.214829:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.214852:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788448769.214857:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826477568:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.214877:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.214917:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826478080:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.214949:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.214972:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826478592:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.214990:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.215020:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826477312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448769.215044:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.215061:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826477824:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.215080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.215096:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826478336:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.215115:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.215131:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826478848:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.215149:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.215166:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788448769.215171:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826477440:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.215214:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.215237:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826477952:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.215257:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.215272:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826478464:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.215291:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.215301:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826478976:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.215326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.215360:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826477184 00000100:00100000:0.0:1788448769.215369:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826477184 00000100:00100000:0.0:1788448769.215421:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826477312 00000100:00100000:0.0:1788448769.215424:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826477312 00000100:00100000:0.0:1788448769.215445:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448769.215477:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875323826477184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448769.215529:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788448769.215588:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875323826477184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.215596:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448769.215620:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448769.215627:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826477312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448769.215638:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788448769.215665:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826477312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.215672:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448769.215694:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826478720 00000100:00100000:0.0:1788448769.215698:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826478720 00000100:00100000:0.0:1788448769.215721:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826478592 00000100:00100000:0.0:1788448769.215724:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826478592 00000100:00100000:0.0:1788448769.215734:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826478848 00000100:00100000:0.0:1788448769.215737:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826478848 00000100:00100000:0.0:1788448769.215750:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826477952 00000100:00100000:0.0:1788448769.215753:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826477952 00000100:00100000:0.0:1788448769.215764:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826478464 00000100:00100000:0.0:1788448769.215766:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826478464 00000100:00100000:0.0:1788448769.215778:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826478976 00000100:00100000:0.0:1788448769.215781:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826478976 00000100:00100000:0.0:1788448769.215794:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788448769.215800:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826478720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.215833:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826478720:12345-0@lo:400:kworker.0 Request processed in 33us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.215840:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788448769.215864:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788448769.215869:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826478592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.215934:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826478592:12345-0@lo:400:kworker.0 Request processed in 64us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.215941:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788448769.215953:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788448769.215958:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826478848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.215984:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826478848:12345-0@lo:400:kworker.0 Request processed in 26us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.215990:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788448769.216000:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448769.216005:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826477952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.216029:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826477952:12345-0@lo:400:kworker.0 Request processed in 24us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.216035:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448769.216048:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788448769.216053:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826478464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.216078:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826478464:12345-0@lo:400:kworker.0 Request processed in 24us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.216083:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788448769.216098:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788448769.216104:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826478976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.216127:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826478976:12345-0@lo:400:kworker.0 Request processed in 24us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.216133:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788448769.216165:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826477568 00000100:00100000:0.0:1788448769.216169:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826477568 00000100:00100000:0.0:1788448769.216193:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826478080 00000100:00100000:0.0:1788448769.216196:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826478080 00000100:00100000:0.0:1788448769.216207:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788448769.216213:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826477568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.216246:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826477568:12345-0@lo:400:kworker.0 Request processed in 33us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.216253:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788448769.216264:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448769.216270:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826478080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.216295:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826478080:12345-0@lo:400:kworker.0 Request processed in 26us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.216302:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448769.216328:0:25164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826477696 00000100:00100000:0.0:1788448769.216332:0:25164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826477696 00000100:00100000:0.0:1788448769.216359:0:25164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826478208 00000100:00100000:0.0:1788448769.216362:0:25164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826478208 00000100:00100000:0.0:1788448769.216373:0:25164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826477824 00000100:00100000:0.0:1788448769.216376:0:25164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826477824 00000100:00100000:0.0:1788448769.216384:0:25164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826478336 00000100:00100000:0.0:1788448769.216386:0:25164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826478336 00000100:00100000:0.0:1788448769.216397:0:25164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448769.216403:0:25164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826477696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.216435:0:25164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826477696:12345-0@lo:400:kworker.0 Request processed in 32us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.216442:0:25164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448769.216452:0:25164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448769.216458:0:25164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826478208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.216493:0:25164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826478208:12345-0@lo:400:kworker.0 Request processed in 35us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.216500:0:25164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448769.216522:0:25164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448769.216530:0:25164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826477824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.216555:0:25164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826477824:12345-0@lo:400:kworker.0 Request processed in 27us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.216561:0:25164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448769.216572:0:25164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448769.216577:0:25164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3645:x1875323826478336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448769.217316:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826479104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448769.221173:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826477568:0@lo:400:kworker.0 00000100:00100000:3.0:1788448769.221264:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826478080:0@lo:400:kworker.0 00010000:00080000:3.0:1788448769.221293:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc19137c700 x1875323826478592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448769.221306:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826478592:0@lo:400:kworker.0 00000100:00100000:3.0:1788448769.221336:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826477184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448769.221357:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826477696:0@lo:400:kworker.0 00000100:00100000:3.0:1788448769.221375:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826478208:0@lo:400:kworker.0 00010000:00080000:3.0:1788448769.221391:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc19137c380 x1875323826478720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448769.221400:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826478720:0@lo:400:kworker.0 00000100:00080000:3.0:1788448769.221455:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448769.221475:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448769.221478:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788448769.221481:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788448769.221509:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826477440 00000100:00100000:3.0:1788448769.221529:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826477440 00000100:00100000:3.0:1788448769.221591:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788448769.221721:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:3645:x1875323826477440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448769.221844:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:3645:x1875323826477440:12345-0@lo:400:kworker.0 Request processed in 243us (6629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448769.221852:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788448769.222124:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3645:1875323826477440:0@lo:400:kworker.0 00010000:00080000:3.0:1788448769.222143:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08201bb80 x1875323826477952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448769.222153:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826477952:0@lo:400:kworker.0 00010000:00080000:3.0:1788448769.222168:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc19137ea00 x1875323826478464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448769.222177:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826478464:0@lo:400:kworker.0 00010000:00080000:3.0:1788448769.222330:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc19137f480 x1875323826478976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448769.222340:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826478976:0@lo:400:kworker.0 00000100:00100000:3.0:1788448769.222366:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826477312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448769.222377:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826477824:0@lo:400:kworker.0 00010000:00080000:3.0:1788448769.222394:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc19137df80 x1875323826478848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448769.222416:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826478848:0@lo:400:kworker.0 00000100:00100000:0.0:1788448769.223169:0:25164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3645:x1875323826478336:12345-0@lo:400:kworker.0 Request processed in 6584us (8045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448769.223194:0:25164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448769.223498:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826478336:0@lo:400:kworker.0 00000100:00100000:1.0:1788448769.225849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448769.232482:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826479104 00000100:00100000:0.0:1788448769.232502:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826479104 00000100:00100000:2.0:1788448769.232724:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448769.232738:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826479104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448769.232782:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788448769.232937:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826479104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (7100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448769.232945:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448769.233152:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826479104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788448769.470628:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788448769.732176:0:25033:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000020:00000004:0.0:1788448769.796447:0:25442:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448769.796697:0:25442:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788448770.494124:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788448770.833409:0:25493:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788448770.833664:0:25493:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788448771.173862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448771.176553:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801192192 00000100:00100000:0.0:1788448771.176567:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801192192 00000100:00100000:0.0:1788448771.176688:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:0.0:1788448771.176698:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1875323801192192:12345-192.168.206.21@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788448771.176726:0:22704:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7dd607f5-2bb4-4330-b02d-7405fa363325@192.168.206.21@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:0.0:1788448771.176757:0:22704:0:(genops.c:1385:class_connect()) connect: client 7dd607f5-2bb4-4330-b02d-7405fa363325, cookie 0xf45a9e4e6b8055c4 00000100:00080000:0.0:1788448771.176910:0:22704:0:(import.c:65:import_set_state_nolock()) ffff9fc19ec41800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448771.177009:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+5:2397:x1875323801192192:12345-192.168.206.21@tcp:250:mount.lustre.0 Request processed in 310us (3155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.177033:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:0.0:1788448771.192948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448771.193107:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801192320 00000100:00100000:3.0:1788448771.193116:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801192320 00000100:00100000:3.0:1788448771.193174:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:3.0:1788448771.193185:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+5:18059:x1875323801192320:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788448771.193202:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448771.193218:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc19e374000/0xf45a9e4e6b8055cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b4f expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448771.193245:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc19e374000/0xf45a9e4e6b8055cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b4f expref: 6 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448771.193256:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc19e374000/0xf45a9e4e6b8055cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b4f expref: 6 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448771.193265:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc19e374000, rc 0) 00000100:00100000:3.0:1788448771.193324:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+6:18059:x1875323801192320:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 142us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448771.193332:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:1.0:1788448771.199424:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448771.199633:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801192448 00000100:00100000:0.0:1788448771.199645:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801192448 00000100:00100000:0.0:1788448771.199707:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 117 00000100:00100000:0.0:1788448771.199718:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+6:18059:x1875323801192448:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788448771.199840:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+6:18059:x1875323801192448:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 123us (425us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448771.199848:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 117 00000100:00100000:1.0:1788448771.210104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448771.210221:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801192576 00000100:00100000:0.0:1788448771.210231:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801192576 00000100:00100000:0.0:1788448771.210290:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:0.0:1788448771.210301:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+6:18059:x1875323801192576:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788448771.210317:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448771.210333:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1a0331200/0xf45a9e4e6b8055d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b56 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448771.210360:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0331200/0xf45a9e4e6b8055d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b56 expref: 7 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448771.210371:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1a0331200/0xf45a9e4e6b8055d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b56 expref: 7 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448771.210639:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331200, rc 0) 00000100:00100000:0.0:1788448771.210698:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+7:18059:x1875323801192576:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 398us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.210720:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:1.0:1788448771.213756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448771.213920:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801192704 00000100:00100000:3.0:1788448771.213929:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801192704 00000100:00100000:3.0:1788448771.213992:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 119 00000100:00100000:3.0:1788448771.214003:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+7:18059:x1875323801192704:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788448771.214157:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+8:18059:x1875323801192704:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 155us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448771.214166:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 119 00000100:00100000:1.0:1788448771.232651:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448771.232973:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801192832 00000100:00100000:0.0:1788448771.232982:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801192832 00000100:00100000:0.0:1788448771.233031:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:0.0:1788448771.233040:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+8:18059:x1875323801192832:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788448771.233166:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+8:18059:x1875323801192832:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 126us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.233174:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:0.0:1788448771.252042:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448771.253051:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801192960 00000100:00100000:1.0:1788448771.253064:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801192960 00000100:00100000:1.0:1788448771.253119:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:1.0:1788448771.253129:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+8:18078:x1875323801192960:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448771.253605:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+8:18078:x1875323801192960:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 474us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448771.253613:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:1.0:1788448771.282172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448771.282264:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801193088 00000100:00100000:3.0:1788448771.282274:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801193088 00000100:00100000:3.0:1788448771.282335:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:3.0:1788448771.282346:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19e6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+8:18078:x1875323801193088:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788448771.282682:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19e6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+8:18078:x1875323801193088:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 336us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448771.282690:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:2.0:1788448771.288164:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448771.292265:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801193216 00000100:00100000:0.0:1788448771.292279:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801193216 00000100:00100000:0.0:1788448771.292350:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:0.0:1788448771.292362:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bc3a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+8:18078:x1875323801193216:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448771.292540:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bc3a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+8:18078:x1875323801193216:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 179us (4383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.292548:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:0.0:1788448771.306610:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448771.310840:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801193344 00000100:00100000:3.0:1788448771.310855:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801193344 00000100:00100000:2.0:1788448771.317980:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 124 00000100:00100000:2.0:1788448771.317995:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bc3a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+8:18059:x1875323801193344:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788448771.318028:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448771.318047:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1b5255800/0xf45a9e4e6b8055d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b87 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448771.318078:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1b5255800/0xf45a9e4e6b8055d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b87 expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448771.318090:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1b5255800/0xf45a9e4e6b8055d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b87 expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448771.318099:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1b5255800, rc 0) 00000100:00100000:2.0:1788448771.318172:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bc3a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+9:18059:x1875323801193344:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 179us (11571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448771.318180:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 124 00000100:00100000:2.0:1788448771.321990:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448771.322079:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801193472 00000100:00100000:1.0:1788448771.322088:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801193472 00000100:00100000:1.0:1788448771.322139:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:1.0:1788448771.322149:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bc3a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+9:18059:x1875323801193472:12345-192.168.206.21@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788448771.322171:0:22704:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788448771.322192:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788448771.322196:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788448771.322200:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788448771.322208:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788448771.322210:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788448771.324190:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bc3a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+9:18059:x1875323801193472:12345-192.168.206.21@tcp:256:mount.lustre.0 Request processed in 2034us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.324202:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:0.0:1788448771.328131:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448771.328310:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801193600 00000100:00100000:3.0:1788448771.328321:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801193600 00000100:00100000:3.0:1788448771.328384:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 126 00000100:00100000:3.0:1788448771.328395:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bc3a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+9:18059:x1875323801193600:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788448771.328410:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448771.328430:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc19e375200/0xf45a9e4e6b8055e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b8e expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448771.328460:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc19e375200/0xf45a9e4e6b8055e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b8e expref: 10 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448771.328471:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc19e375200/0xf45a9e4e6b8055e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b8e expref: 10 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448771.328494:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc19e375200, rc 0) 00000100:00100000:3.0:1788448771.328681:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bc3a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+10:18059:x1875323801193600:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 287us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448771.328688:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 126 00000100:00100000:2.0:1788448771.337664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448771.337753:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801193728 00000100:00100000:0.0:1788448771.337764:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801193728 00000100:00100000:0.0:1788448771.337829:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 127 00000100:00100000:0.0:1788448771.337841:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bc3a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+10:18059:x1875323801193728:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788448771.338023:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bc3a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+10:18059:x1875323801193728:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 184us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.338031:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 127 00000100:00100000:1.0:1788448771.342193:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448771.342329:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801193856 00000100:00100000:3.0:1788448771.342341:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801193856 00000100:00100000:3.0:1788448771.342413:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:3.0:1788448771.342425:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+10:18059:x1875323801193856:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788448771.342628:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+10:18059:x1875323801193856:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 204us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448771.342636:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:1.0:1788448771.351702:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448771.351968:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801193984 00000100:00100000:2.0:1788448771.351980:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801193984 00000100:00100000:2.0:1788448771.352033:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 129 00000100:00100000:2.0:1788448771.352043:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+10:18084:x1875323801193984:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448771.352219:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+10:18084:x1875323801193984:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 176us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448771.352228:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 129 00000100:00100000:2.0:1788448771.364757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448771.364848:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801194112 00000100:00100000:0.0:1788448771.364858:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801194112 00000100:00100000:0.0:1788448771.364929:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:0.0:1788448771.364940:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+10:18084:x1875323801194112:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448771.365093:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+10:18084:x1875323801194112:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 153us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.365101:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:1.0:1788448771.385728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448771.385967:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801194240 00000100:00100000:0.0:1788448771.385978:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801194240 00000100:00100000:0.0:1788448771.386032:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1788448771.386041:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875323801194240:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788448771.386069:0:22711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b@192.168.206.21@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:0.0:1788448771.386117:0:22711:0:(genops.c:1385:class_connect()) connect: client 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b, cookie 0xf45a9e4e6b8055e7 00000004:00100000:0.0:1788448771.386141:0:22711:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788448771.386355:0:22711:0:(import.c:65:import_set_state_nolock()) ffff9fc19ec44000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448771.386433:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:2397:x1875323801194240:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 391us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.386441:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:1.0:1788448771.387056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448771.387132:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801194496 00000100:00100000:3.0:1788448771.387139:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801194496 00000100:00100000:3.0:1788448771.387165:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1788448771.387172:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875323801194496:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788448771.387192:0:25156:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b@192.168.206.21@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:3.0:1788448771.387255:0:25156:0:(genops.c:1385:class_connect()) connect: client 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b, cookie 0xf45a9e4e6b8055ee 00000004:00100000:3.0:1788448771.387273:0:25156:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788448771.387459:0:25156:0:(import.c:65:import_set_state_nolock()) ffff9fc083f26000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448771.387530:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:2397:x1875323801194496:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 356us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448771.387538:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1788448771.401627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448771.401853:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801194368 00000100:00100000:0.0:1788448771.401863:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801194368 00000100:00100000:0.0:1788448771.401974:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:0.0:1788448771.401987:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:0:x1875323801194368:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788448771.402036:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788448771.402125:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:0:x1875323801194368:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 141us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.402133:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00080000:3.0:1788448771.402528:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448771.406443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448771.406533:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801194624 00000100:00100000:3.0:1788448771.406543:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801194624 00000100:00100000:3.0:1788448771.406617:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:3.0:1788448771.406628:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:0:x1875323801194624:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788448771.406666:0:25156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788448771.406748:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:0:x1875323801194624:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 122us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448771.406756:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00080000:1.0:1788448771.407567:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448771.412784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448771.413470:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801194752 00000100:00100000:0.0:1788448771.413481:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801194752 00000100:00100000:0.0:1788448771.413559:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1788448771.413572:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18059:x1875323801194752:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788448771.413604:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788448771.413676:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18059:x1875323801194752:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 106us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.413684:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:2.0:1788448771.420659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448771.420751:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801194880 00000100:00100000:3.0:1788448771.420761:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801194880 00000100:00100000:3.0:1788448771.420832:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1788448771.420844:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18059:x1875323801194880:12345-192.168.206.21@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788448771.420951:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18059:x1875323801194880:12345-192.168.206.21@tcp:40:mount.lustre.0 Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448771.420959:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:1.0:1788448771.423939:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448771.423968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448771.423997:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448771.424116:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801195008 00000100:00100000:2.0:1788448771.424126:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801195008 00000100:00100000:2.0:1788448771.424178:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801195136 00000100:00100000:2.0:1788448771.424181:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801195136 00000100:00100000:2.0:1788448771.424197:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:2.0:1788448771.424205:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875323801195008:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788448771.424237:0:24221:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b@192.168.206.21@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:2.0:1788448771.424265:0:24221:0:(genops.c:1385:class_connect()) connect: client 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b, cookie 0xf45a9e4e6b8055f5 00002000:00100000:2.0:1788448771.424277:0:24221:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b/ffff9fc08260b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788448771.424294:0:24221:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788448771.424449:0:24221:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788448771.424473:0:24221:0:(import.c:65:import_set_state_nolock()) ffff9fc08260e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448771.424539:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:2397:x1875323801195008:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 333us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448771.424547:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:2.0:1788448771.424561:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:2.0:1788448771.424566:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875323801195136:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788448771.424580:0:24221:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b@192.168.206.21@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:2.0:1788448771.424593:0:24221:0:(genops.c:1385:class_connect()) connect: client 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b, cookie 0xf45a9e4e6b8055fc 00002000:00100000:2.0:1788448771.424598:0:24221:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b/ffff9fc08260b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788448771.424613:0:24221:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788448771.424717:0:24221:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788448771.424731:0:24221:0:(import.c:65:import_set_state_nolock()) ffff9fc082608000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448771.424754:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:2397:x1875323801195136:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 187us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448771.424760:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:0.0:1788448771.425074:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801195264 00000100:00100000:0.0:1788448771.425080:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801195264 00000100:00100000:0.0:1788448771.425112:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:0.0:1788448771.425120:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18059:x1875323801195264:12345-192.168.206.21@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788448771.425162:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18059:x1875323801195264:12345-192.168.206.21@tcp:900:mount.lustre.0 Request processed in 43us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.425169:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:1.0:1788448771.430190:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448771.430594:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801195392 00000100:00100000:2.0:1788448771.430604:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801195392 00000100:00100000:2.0:1788448771.430654:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:2.0:1788448771.430665:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18059:x1875323801195392:12345-192.168.206.21@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788448771.432936:0:22713:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2187us 00000004:00200000:3.0:1788448771.454448:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788448771.454591:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18059:x1875323801195392:12345-192.168.206.21@tcp:33:mount.lustre.0 Request processed in 23922us (24405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448771.454605:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00010000:00010000:2.0:1788448771.518047:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448771.666257:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448771.666343:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801195520 00000100:00100000:0.0:1788448771.666352:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801195520 00000100:00100000:0.0:1788448771.666416:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:0.0:1788448771.666426:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18107:x1875323801195520:12345-192.168.206.21@tcp:101:mkdir.0 00010000:00010000:0.0:1788448771.666444:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448771.666467:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805603 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0bbf expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448771.666558:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80560a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448771.666571:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80560a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448771.666586:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80560a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448771.666633:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788448771.666636:0:22711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448771.666672:0:22711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80560a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448771.666696:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805603 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bbf expref: 8 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448771.666713:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80560a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bbf expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448771.666721:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc189117000) 00010000:00010000:0.0:1788448771.666724:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448771.666727:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330a00, rc 0) 00000100:00100000:0.0:1788448771.666783:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:18107:x1875323801195520:12345-192.168.206.21@tcp:101:mkdir.0 Request processed in 359us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448771.666790:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000040:00080000:2.0:1788448771.966733:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788448772.542089:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448772.798233:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448772.798259:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826479232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448772.798347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448772.798654:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826479232 00000100:00100000:2.0:1788448772.798663:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826479232 00000100:00100000:2.0:1788448772.798724:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448772.798735:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826479232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448772.798764:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788448772.798813:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826479232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448772.798820:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788448772.798912:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448772.800108:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826479232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448773.310346:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826479488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448773.310406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448773.310459:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448773.310465:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826479360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448773.310483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448773.310593:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826479488 00000100:00100000:1.0:1788448773.310601:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826479488 00000100:00100000:1.0:1788448773.310636:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826479360 00000100:00100000:1.0:1788448773.310638:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826479360 00000100:00100000:1.0:1788448773.310650:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788448773.310658:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826479488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448773.310690:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788448773.310723:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788448773.310733:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826479488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448773.310742:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788448773.310903:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826479488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448773.312045:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826479360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448773.312084:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788448773.312158:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826479360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1423us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448773.312191:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788448773.314195:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826479360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448773.491767:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448773.492251:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801195648 00000100:00100000:3.0:1788448773.492261:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801195648 00000100:00100000:3.0:1788448773.492463:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:3.0:1788448773.492474:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:18160:x1875323801195648:12345-192.168.206.21@tcp:41:lfs.0 00000004:00000024:3.0:1788448773.492512:0:25156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788448773.492603:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:18160:x1875323801195648:12345-192.168.206.21@tcp:41:lfs.0 Request processed in 131us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448773.492611:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00080000:1.0:1788448773.493132:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448773.495510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448773.495607:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801195776 00000100:00100000:0.0:1788448773.495624:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801195776 00000100:00100000:0.0:1788448773.495717:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:0.0:1788448773.495728:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18160:x1875323801195776:12345-192.168.206.21@tcp:41:lfs.0 00000004:00000024:0.0:1788448773.495759:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788448773.495856:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18160:x1875323801195776:12345-192.168.206.21@tcp:41:lfs.0 Request processed in 129us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448773.495864:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00080000:1.0:1788448773.496150:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448773.498611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448773.498725:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801195904 00000100:00100000:0.0:1788448773.498737:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801195904 00000100:00100000:0.0:1788448773.498830:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:0.0:1788448773.498842:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18160:x1875323801195904:12345-192.168.206.21@tcp:13:lfs.0 00002000:00000024:0.0:1788448773.498875:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00080000:1.0:1788448773.499152:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448773.499235:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18160:x1875323801195904:12345-192.168.206.21@tcp:13:lfs.0 Request processed in 394us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448773.499253:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:3.0:1788448773.501253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448773.501495:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801196032 00000100:00100000:0.0:1788448773.501507:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801196032 00000100:00100000:0.0:1788448773.501631:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1788448773.501644:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18160:x1875323801196032:12345-192.168.206.21@tcp:13:lfs.0 00002000:00000024:0.0:1788448773.501683:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788448773.501784:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18160:x1875323801196032:12345-192.168.206.21@tcp:13:lfs.0 Request processed in 143us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448773.501792:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00080000:1.0:1788448773.501908:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788448773.566443:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448773.695971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448773.696223:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801196160 00000100:00100000:1.0:1788448773.696236:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801196160 00000100:00100000:1.0:1788448773.696321:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00100000:1.0:1788448773.696335:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+10:18195:x1875323801196160:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788448773.696359:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448773.696394:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fc200/0xf45a9e4e6b805611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0bc6 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448773.696434:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fc200/0xf45a9e4e6b805611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bc6 expref: 11 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448773.696446:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fc200/0xf45a9e4e6b805611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bc6 expref: 11 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448773.696457:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fc200, rc 0) 00000100:00100000:1.0:1788448773.696540:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18195:x1875323801196160:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 208us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448773.696548:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00100000:3.0:1788448773.701969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448773.702165:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801196288 00000100:00100000:2.0:1788448773.702179:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801196288 00000100:00100000:2.0:1788448773.702261:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 132 00000100:00100000:2.0:1788448773.702274:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18195:x1875323801196288:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788448773.702725:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18195:x1875323801196288:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 452us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448773.702733:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 132 00000100:00100000:3.0:1788448773.705761:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448773.705910:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801196416 00000100:00100000:0.0:1788448773.705922:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801196416 00000100:00100000:0.0:1788448773.705989:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 133 00000100:00100000:0.0:1788448773.706001:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18195:x1875323801196416:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788448773.706205:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18195:x1875323801196416:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 204us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448773.706214:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 133 00000100:00100000:3.0:1788448773.713768:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448773.714564:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801196544 00000100:00100000:2.0:1788448773.714579:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801196544 00000100:00100000:2.0:1788448773.714663:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 134 00000100:00100000:2.0:1788448773.714696:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18199:x1875323801196544:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448773.714938:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18199:x1875323801196544:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 243us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448773.714946:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 134 00000100:00100000:1.0:1788448773.741164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448773.742667:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801196672 00000100:00100000:3.0:1788448773.742684:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801196672 00000100:00100000:3.0:1788448773.742780:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 135 00000100:00100000:3.0:1788448773.742794:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18199:x1875323801196672:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788448773.743226:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18199:x1875323801196672:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 433us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448773.743236:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 135 00000100:00100000:3.0:1788448773.748614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448773.750934:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801196800 00000100:00100000:0.0:1788448773.750955:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801196800 00000100:00100000:0.0:1788448773.751051:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 136 00000100:00100000:0.0:1788448773.751064:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18199:x1875323801196800:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448773.751274:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18199:x1875323801196800:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 212us (2675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448773.751284:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 136 00000100:00100000:0.0:1788448773.756117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448773.756511:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801196928 00000100:00100000:2.0:1788448773.756524:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801196928 00000100:00100000:2.0:1788448773.756591:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 137 00000100:00100000:2.0:1788448773.756603:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18195:x1875323801196928:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788448773.756626:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448773.756649:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1b5254600/0xf45a9e4e6b805618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0bf7 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448773.756688:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1b5254600/0xf45a9e4e6b805618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bf7 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448773.756702:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1b5254600/0xf45a9e4e6b805618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bf7 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448773.756714:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1b5254600, rc 0) 00000100:00100000:2.0:1788448773.756929:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+12:18195:x1875323801196928:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 327us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448773.756937:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 137 00000100:00100000:1.0:1788448773.764744:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448773.765003:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801197056 00000100:00100000:3.0:1788448773.765017:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801197056 00000100:00100000:3.0:1788448773.765088:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 138 00000100:00100000:3.0:1788448773.765102:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+12:18195:x1875323801197056:12345-192.168.206.21@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788448773.765152:0:22703:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788448773.765174:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788448773.765178:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788448773.765181:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788448773.765184:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788448773.765186:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788448773.779584:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+12:18195:x1875323801197056:12345-192.168.206.21@tcp:256:mount.lustre.0 Request processed in 14468us (14848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448773.779603:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 138 00000100:00100000:0.0:1788448773.787260:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448773.787528:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801197184 00000100:00100000:1.0:1788448773.787541:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801197184 00000100:00100000:1.0:1788448773.787666:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 139 00000100:00100000:1.0:1788448773.787679:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+12:18195:x1875323801197184:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788448773.787713:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448773.787735:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fca00/0xf45a9e4e6b80561f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0bfe expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448773.787774:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fca00/0xf45a9e4e6b80561f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bfe expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448773.787787:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fca00/0xf45a9e4e6b80561f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bfe expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448773.787799:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fca00, rc 0) 00000100:00100000:1.0:1788448773.787871:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18195:x1875323801197184:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 195us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448773.787927:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 139 00000100:00100000:3.0:1788448773.792828:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448773.800349:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801197312 00000100:00100000:2.0:1788448773.800441:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801197312 00000100:00100000:2.0:1788448773.800541:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 140 00000100:00100000:2.0:1788448773.800554:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18195:x1875323801197312:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788448773.801112:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18195:x1875323801197312:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 556us (8296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448773.801123:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 140 00000100:00100000:3.0:1788448773.803334:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448773.803709:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801197440 00000100:00100000:1.0:1788448773.803720:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801197440 00000100:00100000:1.0:1788448773.803786:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 141 00000100:00100000:1.0:1788448773.803799:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18195:x1875323801197440:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788448773.804951:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18195:x1875323801197440:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 1145us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448773.804964:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 141 00000100:00100000:0.0:1788448773.809079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448773.810465:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801197568 00000100:00100000:2.0:1788448773.810785:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801197568 00000100:00100000:2.0:1788448773.810874:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 142 00000100:00100000:2.0:1788448773.810931:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18204:x1875323801197568:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448773.811142:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18204:x1875323801197568:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 215us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448773.811152:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 142 00000100:00100000:2.0:1788448773.816723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448773.816844:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801197696 00000100:00100000:1.0:1788448773.816857:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801197696 00000100:00100000:0.0:1788448773.817175:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 143 00000100:00100000:0.0:1788448773.817190:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18204:x1875323801197696:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448773.817546:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18204:x1875323801197696:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 358us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448773.817556:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 143 00000100:00100000:3.0:1788448773.825629:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448773.826385:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801197824 00000100:00100000:0.0:1788448773.826399:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801197824 00000100:00100000:0.0:1788448773.827638:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:0.0:1788448773.827654:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875323801197824:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788448773.827702:0:25156:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9d299c3e-f97f-4c06-8a39-fe013752bf2d@192.168.206.21@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:0.0:1788448773.827763:0:25156:0:(genops.c:1385:class_connect()) connect: client 9d299c3e-f97f-4c06-8a39-fe013752bf2d, cookie 0xf45a9e4e6b805626 00000004:00100000:0.0:1788448773.827805:0:25156:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788448773.827975:0:25156:0:(import.c:65:import_set_state_nolock()) ffff9fc1b51bc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448773.828599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448773.828706:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801198080 00000100:00100000:1.0:1788448773.828715:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801198080 00000100:00100000:1.0:1788448773.828754:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:1.0:1788448773.828762:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1875323801198080:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788448773.828800:0:22712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 9d299c3e-f97f-4c06-8a39-fe013752bf2d@192.168.206.21@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:1.0:1788448773.828832:0:22712:0:(genops.c:1385:class_connect()) connect: client 9d299c3e-f97f-4c06-8a39-fe013752bf2d, cookie 0xf45a9e4e6b80562d 00000004:00100000:1.0:1788448773.828852:0:22712:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788448773.829030:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9fc082461000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448773.829399:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:2397:x1875323801197824:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 1741us (3780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448773.829409:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:1.0:1788448773.836778:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:2397:x1875323801198080:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 7997us (8164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448773.836800:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:3.0:1788448773.837839:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448773.838082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448773.838213:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801197952 00000100:00100000:2.0:1788448773.838224:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801197952 00000100:00080000:1.0:1788448773.838275:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448773.838302:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801198336 00000100:00100000:2.0:1788448773.838305:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801198336 00000100:00100000:2.0:1788448773.838336:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:2.0:1788448773.838348:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+7:0:x1875323801197952:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788448773.838396:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788448773.838478:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+7:0:x1875323801197952:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 131us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448773.838496:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:2.0:1788448773.838514:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:2.0:1788448773.838521:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:18195:x1875323801198336:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788448773.838533:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788448773.838557:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:18195:x1875323801198336:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 36us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448773.838580:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:2.0:1788448773.846512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448773.846749:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448773.846841:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801198208 00000100:00100000:1.0:1788448773.846854:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801198208 00000100:00100000:1.0:1788448773.846968:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801198464 00000100:00100000:1.0:1788448773.846972:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801198464 00000100:00100000:1.0:1788448773.847014:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1788448773.847025:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:0:x1875323801198208:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788448773.847070:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788448773.847150:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:0:x1875323801198208:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 126us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448773.847158:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1788448773.847179:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:1.0:1788448773.847185:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b6560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:18195:x1875323801198464:12345-192.168.206.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788448773.847217:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b6560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:18195:x1875323801198464:12345-192.168.206.21@tcp:40:mount.lustre.0 Request processed in 33us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448773.847223:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00080000:3.0:1788448773.848017:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448773.854764:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448773.855054:0:25164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801198592 00000100:00100000:0.0:1788448773.855069:0:25164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801198592 00000100:00100000:0.0:1788448773.855125:0:25164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:0.0:1788448773.855135:0:25164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1875323801198592:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788448773.855178:0:25164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9d299c3e-f97f-4c06-8a39-fe013752bf2d@192.168.206.21@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:0.0:1788448773.855230:0:25164:0:(genops.c:1385:class_connect()) connect: client 9d299c3e-f97f-4c06-8a39-fe013752bf2d, cookie 0xf45a9e4e6b805634 00002000:00100000:0.0:1788448773.855246:0:25164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9d299c3e-f97f-4c06-8a39-fe013752bf2d/ffff9fc1b51be800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788448773.855289:0:25164:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788448773.855388:0:25164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788448773.855591:0:25164:0:(import.c:65:import_set_state_nolock()) ffff9fc1b51be000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448773.855681:0:25164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:2397:x1875323801198592:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 545us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448773.855690:0:25164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:0.0:1788448773.855758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448773.856761:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448773.856796:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801198848 00000100:00100000:3.0:1788448773.856803:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801198848 00000100:00100000:3.0:1788448773.856852:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:3.0:1788448773.856861:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:18195:x1875323801198848:12345-192.168.206.21@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788448773.856956:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:18195:x1875323801198848:12345-192.168.206.21@tcp:900:mount.lustre.0 Request processed in 96us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448773.856964:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:2.0:1788448773.859010:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801198720 00000100:00100000:2.0:1788448773.859026:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801198720 00000100:00100000:2.0:1788448773.859094:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:2.0:1788448773.859103:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875323801198720:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788448773.859174:0:24221:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9d299c3e-f97f-4c06-8a39-fe013752bf2d@192.168.206.21@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:2.0:1788448773.859645:0:24221:0:(genops.c:1385:class_connect()) connect: client 9d299c3e-f97f-4c06-8a39-fe013752bf2d, cookie 0xf45a9e4e6b80563b 00002000:00100000:2.0:1788448773.859662:0:24221:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9d299c3e-f97f-4c06-8a39-fe013752bf2d/ffff9fc1b51a0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788448773.859676:0:24221:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788448773.859765:0:24221:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788448773.859869:0:24221:0:(import.c:65:import_set_state_nolock()) ffff9fc1b51a3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448773.859984:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:2397:x1875323801198720:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 879us (4224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448773.859994:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:3.0:1788448773.863733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448773.868385:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801198976 00000100:00100000:0.0:1788448773.868405:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801198976 00000100:00100000:0.0:1788448773.868813:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:0.0:1788448773.868827:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:18195:x1875323801198976:12345-192.168.206.21@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788448773.868956:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788448773.869084:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:18195:x1875323801198976:12345-192.168.206.21@tcp:33:mount.lustre.0 Request processed in 260us (5366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448773.869094:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:3.0:1788448774.030521:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448774.030685:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801199104 00000100:00100000:1.0:1788448774.030699:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801199104 00000100:00100000:1.0:1788448774.030795:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:1.0:1788448774.030807:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:18227:x1875323801199104:12345-192.168.206.21@tcp:101:mkdir.0 00010000:00010000:1.0:1788448774.030834:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448774.030862:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b805642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c2f expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448774.030972:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448774.030990:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448774.031008:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448774.031072:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788448774.031076:0:22712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448774.031102:0:22712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448774.031135:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b805642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c2f expref: 8 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448774.031157:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c2f expref: 7 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448774.031167:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc189117000) 00010000:00010000:1.0:1788448774.031170:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448774.031175:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd600, rc 0) 00000100:00100000:1.0:1788448774.031659:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+7:18227:x1875323801199104:12345-192.168.206.21@tcp:101:mkdir.0 Request processed in 850us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448774.031681:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:2.0:1788448774.334690:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3647:1875323826479616:0@lo:400:kworker.0 00000100:00100000:2.0:1788448774.334801:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448774.335147:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826479872:0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.335976:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826480000:0@lo:400:kworker.0 00000100:00100000:2.0:1788448774.336063:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826480128:0@lo:400:kworker.0 00000100:00100000:3.0:1788448774.336200:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826479744:0@lo:400:kworker.0 00000100:00100000:1.0:1788448774.336266:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448774.338106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448774.338170:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826480512:0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.338225:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448774.338248:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826481024:0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.338289:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448774.338659:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826481024 00000100:00100000:0.0:1788448774.338671:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826481024 00000100:00100000:0.0:1788448774.338750:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788448774.338763:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826481024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.338857:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826481024:12345-0@lo:400:kworker.0 Request processed in 98us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448774.338866:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788448774.338915:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448774.338929:0:25164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826479872 00000100:00100000:0.0:1788448774.338934:0:25164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826479872 00000100:00100000:0.0:1788448774.338969:0:25164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826480000 00000100:00100000:0.0:1788448774.338972:0:25164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826480000 00000100:00100000:0.0:1788448774.338992:0:25164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826480512 00000100:00100000:0.0:1788448774.338994:0:25164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826480512 00000100:00100000:0.0:1788448774.339008:0:25164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448774.339015:0:25164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826479872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.339049:0:25164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826479872:12345-0@lo:400:kworker.0 Request processed in 35us (2784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448774.339055:0:25164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448774.339065:0:25164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448774.339070:0:25164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826480000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.339091:0:25164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826480000:12345-0@lo:400:kworker.0 Request processed in 22us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448774.339096:0:25164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448774.339104:0:25164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448774.339110:0:25164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826480512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.339133:0:25164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826480512:12345-0@lo:400:kworker.0 Request processed in 24us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448774.339138:0:25164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788448774.339159:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448774.339161:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448774.339454:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826480000:0@lo:400:kworker.0 00000100:00100000:2.0:1788448774.342725:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448774.342798:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826480640:0@lo:400:kworker.0 00000100:00100000:2.0:1788448774.342922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448774.342945:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826481152:0@lo:400:kworker.0 00000100:00100000:2.0:1788448774.342987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448774.343024:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448774.343031:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826481280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448774.343045:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788448774.343057:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448774.343070:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826480512:0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.343087:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826481024:0@lo:400:kworker.0 00000100:00100000:2.0:1788448774.343105:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826480128 00000100:00100000:0.0:1788448774.343106:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448774.343111:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826481408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448774.343112:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826480128 00000100:00100000:0.0:1788448774.343138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448774.343155:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826480640 00000100:00100000:2.0:1788448774.343158:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826480640 00000100:00100000:0.0:1788448774.343169:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826481152 00000100:00100000:0.0:1788448774.343173:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826481152 00000100:00100000:2.0:1788448774.343175:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788448774.343202:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788448774.343209:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826480640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.343269:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826480640:12345-0@lo:400:kworker.0 Request processed in 60us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448774.343437:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788448774.343537:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788448774.343840:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826481152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.343904:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826481152:12345-0@lo:400:kworker.0 Request processed in 359us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448774.343910:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788448774.343932:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1788448774.345056:0:23467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788448774.345152:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826479616 00000100:00100000:0.0:1788448774.345160:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826479616 00000100:00100000:0.0:1788448774.345218:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788448774.345228:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:3647:x1875323826479616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.345301:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:3647:x1875323826479616:12345-0@lo:400:kworker.0 Request processed in 74us (10501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448774.345322:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788448774.345976:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826480128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.346740:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826481536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448774.349038:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448774.349114:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826480256:0@lo:400:kworker.0 00000100:00100000:3.0:1788448774.349202:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448774.349225:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826480768:0@lo:400:kworker.0 00000100:00100000:3.0:1788448774.349255:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448774.349339:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826479744 00000100:00100000:3.0:1788448774.349350:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826479744 00000100:00100000:3.0:1788448774.349411:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826480256 00000100:00100000:3.0:1788448774.349415:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826480256 00000100:00100000:3.0:1788448774.349443:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788448774.349453:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826479744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448774.349528:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826479744:12345-0@lo:400:kworker.0 Request processed in 76us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448774.349537:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788448774.349555:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788448774.349562:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826480256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448774.349594:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826480256:12345-0@lo:400:kworker.0 Request processed in 32us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448774.349600:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788448774.349668:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826479744:0@lo:400:kworker.0 00000100:00100000:3.0:1788448774.349680:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826480256:0@lo:400:kworker.0 00000100:00100000:3.0:1788448774.349707:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826480768 00000100:00100000:3.0:1788448774.349711:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826480768 00000100:00100000:3.0:1788448774.349747:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788448774.349753:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826480768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448774.349791:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826480768:12345-0@lo:400:kworker.0 Request processed in 38us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448774.349798:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788448774.349835:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448774.349859:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826480768:0@lo:400:kworker.0 00000100:00100000:3.0:1788448774.349940:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826481280 00000100:00100000:3.0:1788448774.349944:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826481280 00000100:00100000:3.0:1788448774.349963:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826481408 00000100:00100000:3.0:1788448774.349966:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826481408 00000100:00100000:3.0:1788448774.349977:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448774.349983:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826481280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448774.350002:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788448774.350038:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826481280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (6980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448774.350044:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448774.350055:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448774.350060:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826481408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448774.350069:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788448774.350091:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826481408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (6953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448774.350097:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448774.350153:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826481280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448774.350169:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826480640:0@lo:400:kworker.0 00010000:00080000:3.0:1788448774.350186:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835d0e00 x1875323826481152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448774.350197:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826481152:0@lo:400:kworker.0 00000100:00100000:3.0:1788448774.350211:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3647:1875323826479616:0@lo:400:kworker.0 00000100:00100000:0.0:1788448774.351683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448774.351748:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826481408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448774.351862:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826479872:0@lo:400:kworker.0 00000100:00100000:1.0:1788448774.351877:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826480384:0@lo:400:kworker.0 00000100:00100000:1.0:1788448774.351929:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448774.351974:0:25164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826480384 00000100:00100000:1.0:1788448774.351981:0:25164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826480384 00000100:00100000:1.0:1788448774.352039:0:25164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448774.352048:0:25164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826480384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448774.352093:0:25164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826480384:12345-0@lo:400:kworker.0 Request processed in 47us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448774.352101:0:25164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788448774.352129:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448774.352146:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826480384:0@lo:400:kworker.0 00000100:00100000:1.0:1788448774.352154:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826480896:0@lo:400:kworker.0 00000100:00100000:1.0:1788448774.352186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448774.352233:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826480896 00000100:00100000:1.0:1788448774.352237:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826480896 00000100:00100000:1.0:1788448774.352272:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788448774.352377:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448774.352438:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826480896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448774.352669:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826480896:12345-0@lo:400:kworker.0 Request processed in 390us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448774.352678:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788448774.352763:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835d0700 x1875323826480896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448774.352843:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826480896:0@lo:400:kworker.0 00000100:00100000:3.0:1788448774.353654:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826481536 00000100:00100000:3.0:1788448774.353674:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826481536 00000100:00100000:3.0:1788448774.353732:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448774.353742:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826481536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448774.353765:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788448774.354052:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826481536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 310us (2376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448774.354059:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788448774.354287:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826481536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448774.357068:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826480128:12345-0@lo:400:kworker.0 Request processed in 13870us (14340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448774.357088:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788448774.357740:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826480128:0@lo:400:kworker.0 00010000:00010000:2.0:1788448774.590033:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448775.615564:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448776.643787:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788448777.409458:0:23445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9d299c3e-f97f-4c06-8a39-fe013752bf2d 00000001:00100000:3.0:1788448777.409483:0:23445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b 00000001:00100000:1.0:1788448777.409693:0:22690:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9d299c3e-f97f-4c06-8a39-fe013752bf2d 00000001:00100000:1.0:1788448777.409700:0:22690:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b 00000001:00100000:1.0:1788448777.418583:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9d299c3e-f97f-4c06-8a39-fe013752bf2d 00000001:00100000:1.0:1788448777.418601:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b 00000001:00100000:1.0:1788448777.423061:0:25033:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9d299c3e-f97f-4c06-8a39-fe013752bf2d 00000001:00100000:1.0:1788448777.423075:0:25033:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 51dd0700-0e8e-4641-b0ab-f8f57ad4c26b 00010000:00010000:3.0:1788448777.662983:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788448777.729674:0:25591:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788448777.918312:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826481664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448777.918413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448777.918732:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826481664 00000100:00100000:1.0:1788448777.918744:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826481664 00000100:00100000:1.0:1788448777.918825:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448777.918838:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826481664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448777.918876:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788448777.918956:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826481664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448777.918963:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448777.919014:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826481664:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788448777.919152:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448778.435856:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826481792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448778.435986:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448778.436752:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826481792 00000100:00100000:1.0:1788448778.436765:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826481792 00000100:00100000:1.0:1788448778.436843:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788448778.436856:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826481792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448778.436931:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788448778.437007:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826481792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448778.437015:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788448778.437087:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826481792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448778.437637:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826481920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448778.437684:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448778.438641:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826481920 00000100:00100000:2.0:1788448778.438651:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826481920 00000100:00100000:2.0:1788448778.438707:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788448778.438728:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826481920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448778.438763:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788448778.438841:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826481920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448778.438849:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788448778.439037:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826481920:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788448778.686343:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448779.112078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448779.112131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448779.112156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448779.112173:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448779.112187:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448779.112211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448779.112228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448779.112248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448779.112272:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448779.112302:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801199744 00000100:00100000:1.0:1788448779.112314:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801199744 00000100:00100000:1.0:1788448779.112380:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801200256 00000100:00100000:1.0:1788448779.112384:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801200256 00000100:00100000:1.0:1788448779.112396:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801199616 00000100:00100000:1.0:1788448779.112398:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801199616 00000100:00100000:1.0:1788448779.112410:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801200128 00000100:00100000:1.0:1788448779.112412:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801200128 00000100:00100000:1.0:1788448779.112429:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:1.0:1788448779.112441:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2398:x1875323801199744:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448779.112559:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2398:x1875323801199744:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 119us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.112568:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:1.0:1788448779.112591:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:1.0:1788448779.112598:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2398:x1875323801200256:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448779.112624:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2398:x1875323801200256:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.112631:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:1.0:1788448779.112642:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:1.0:1788448779.112656:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2398:x1875323801199616:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448779.112679:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2398:x1875323801199616:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.112684:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:1.0:1788448779.112694:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:1.0:1788448779.112700:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2398:x1875323801200128:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448779.112808:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801199232 00000100:00100000:0.0:1788448779.112813:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801199232 00000100:00100000:0.0:1788448779.112847:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00100000:0.0:1788448779.112854:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+13:2398:x1875323801199232:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448779.112927:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2398:x1875323801200128:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 226us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.112934:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:1.0:1788448779.112956:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801199488 00000100:00100000:1.0:1788448779.112960:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801199488 00000100:00100000:1.0:1788448779.112981:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801200000 00000100:00100000:1.0:1788448779.112984:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801200000 00000100:00100000:1.0:1788448779.112996:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801199360 00000100:00100000:1.0:1788448779.112998:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801199360 00000100:00100000:1.0:1788448779.113010:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801199872 00000100:00100000:1.0:1788448779.113013:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801199872 00000100:00100000:1.0:1788448779.113028:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:1.0:1788448779.113035:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2398:x1875323801199488:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448779.127187:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+13:2398:x1875323801199232:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 14316us (15119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448779.127206:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00100000:0.0:1788448779.127315:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:0.0:1788448779.127330:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2398:x1875323801200000:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448779.127388:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2398:x1875323801200000:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (15215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448779.127394:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:0.0:1788448779.127415:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:0.0:1788448779.127422:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:2398:x1875323801199360:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448779.127446:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:2398:x1875323801199360:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (15234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448779.127453:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:0.0:1788448779.127481:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:0.0:1788448779.127489:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:2398:x1875323801199872:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448779.127526:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:2398:x1875323801199872:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (15278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448779.127532:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00080000:0.0:1788448779.127567:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448779.127573:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448779.127577:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448779.127580:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448779.149902:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2398:x1875323801199488:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36837us (37740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.149923:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:3.0:1788448779.454429:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826482176:0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.454718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448779.454781:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826482688:0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.454804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448779.454825:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826483200:0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.454849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448779.454876:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788448779.454904:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826482304:0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.454932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448779.454949:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826482816:0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.455041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448779.455085:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826483328:0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.455115:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448779.455154:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826482176 00000100:00100000:3.0:1788448779.455162:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826482176 00000100:00100000:3.0:1788448779.455214:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826482688 00000100:00100000:3.0:1788448779.455217:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826482688 00000100:00100000:3.0:1788448779.455234:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788448779.455244:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826482176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.455307:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826482176:12345-0@lo:400:kworker.0 Request processed in 63us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448779.455316:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788448779.455551:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3646:1875323826482048:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.455591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448779.455623:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826482560:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.455663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448779.455685:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826483072:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.455706:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448779.455723:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826483584:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.455744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448779.455760:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788448779.455765:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826482432:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.455792:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448779.455810:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826482944:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.455835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448779.455852:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826483456:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.455876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448779.455931:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788448779.455941:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826482688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.456102:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826482688:12345-0@lo:400:kworker.0 Request processed in 162us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.456110:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788448779.456136:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826482304 00000100:00100000:1.0:1788448779.456142:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826482304 00000100:00100000:1.0:1788448779.456184:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826482816 00000100:00100000:1.0:1788448779.456187:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826482816 00000100:00100000:1.0:1788448779.456199:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826482432 00000100:00100000:1.0:1788448779.456202:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826482432 00000100:00100000:1.0:1788448779.456214:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826482944 00000100:00100000:1.0:1788448779.456216:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826482944 00000100:00100000:1.0:1788448779.456230:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448779.456236:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826482304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.456277:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826482304:12345-0@lo:400:kworker.0 Request processed in 41us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.456284:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448779.456300:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448779.456306:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826482816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.457180:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826483200 00000100:00100000:3.0:1788448779.457190:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826483200 00000100:00100000:3.0:1788448779.457222:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826483328 00000100:00100000:3.0:1788448779.457225:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826483328 00000100:00100000:3.0:1788448779.457237:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826482560 00000100:00100000:3.0:1788448779.457240:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826482560 00000100:00100000:3.0:1788448779.457251:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826483072 00000100:00100000:3.0:1788448779.457254:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826483072 00000100:00100000:3.0:1788448779.457263:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826483584 00000100:00100000:3.0:1788448779.457266:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826483584 00000100:00100000:3.0:1788448779.457278:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826483456 00000100:00100000:3.0:1788448779.457281:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826483456 00000100:00100000:3.0:1788448779.457296:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788448779.457303:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826483200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.458823:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826483200:12345-0@lo:400:kworker.0 Request processed in 1510us (3963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448779.458837:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788448779.458875:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788448779.458899:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826483328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.459074:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826482816:12345-0@lo:400:kworker.0 Request processed in 23us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.459086:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448779.459109:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448779.459119:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826482432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.459164:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826482432:12345-0@lo:400:kworker.0 Request processed in 48us (3370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.459171:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448779.459185:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448779.459192:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826482944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.459220:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826482944:12345-0@lo:400:kworker.0 Request processed in 28us (3385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.459226:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448779.459256:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788448779.459264:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826482560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.459294:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826482560:12345-0@lo:400:kworker.0 Request processed in 32us (3631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.459301:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788448779.459315:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788448779.459322:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826483072:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788448779.459679:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448779.459686:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448779.459689:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448779.459692:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448779.459710:0:25156:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788448779.459720:0:25156:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788448779.459742:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826483840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448779.459799:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448779.459835:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448779.459843:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826483712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448779.459869:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448779.459919:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826483840 00000100:00100000:0.0:1788448779.459927:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826483840 00000100:00100000:3.0:1788448779.460093:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826483328:12345-0@lo:400:kworker.0 Request processed in 73us (3838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448779.460104:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788448779.460125:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448779.460135:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826483584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.460173:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826483584:12345-0@lo:400:kworker.0 Request processed in 41us (4428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448779.460179:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448779.460190:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788448779.460197:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826483456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.460226:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826483456:12345-0@lo:400:kworker.0 Request processed in 30us (4349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448779.460231:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788448779.460263:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826482048 00000100:00100000:3.0:1788448779.460267:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826482048 00000100:00100000:3.0:1788448779.460294:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788448779.460300:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:3646:x1875323826482048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.460558:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826483072:12345-0@lo:400:kworker.0 Request processed in 1236us (4850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.460565:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788448779.460723:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826483712 00000100:00100000:1.0:1788448779.460728:0:24222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826483712 00000100:00100000:1.0:1788448779.460751:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448779.460758:0:24222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826483712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448779.460786:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788448779.460829:0:24222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826483712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448779.460835:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448779.460861:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826483968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448779.460932:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448779.462076:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:3646:x1875323826482048:12345-0@lo:400:kworker.0 Request processed in 30us (4738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448779.462091:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788448779.462219:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826482304:0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.462236:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826482816:0@lo:400:kworker.0 00010000:00080000:3.0:1788448779.462253:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bff60000 x1875323826483328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448779.462282:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826483328:0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.462299:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826482176:0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.462314:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826482688:0@lo:400:kworker.0 00000100:00100000:3.0:1788448779.462328:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826483200:0@lo:400:kworker.0 00000100:00100000:0.0:1788448779.462615:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826483968 00000100:00100000:0.0:1788448779.462624:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826483968 00000100:00100000:0.0:1788448779.462660:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788448779.462672:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826483840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448779.462698:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788448779.462768:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826483840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (2968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448779.462774:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788448779.462791:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448779.462798:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826483968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448779.462809:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788448779.462839:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826483968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448779.462845:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448779.462907:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826483712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448779.462923:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826483840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448779.464855:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826483968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448779.464941:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826482432:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.466056:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826482944:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.466094:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826483456:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.466106:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3646:1875323826482048:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.466118:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826482560:0@lo:400:kworker.0 00000100:00100000:1.0:1788448779.466131:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826483072:0@lo:400:kworker.0 00010000:00080000:1.0:1788448779.466148:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bff62680 x1875323826483584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448779.466174:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826483584:0@lo:400:kworker.0 00010000:00010000:1.0:1788448779.723557:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448780.740346:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788448781.183521:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788448781.759487:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788448782.540351:0:25740:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff60209bb0 20000000:00000080:0.0:1788448782.540450:0:25740:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc19e336400 uarg=0000000000000000 20000000:01000000:0.0:1788448782.540495:0:25740:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788448782.540501:0:25740:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788448782.540511:0:25740:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788448782.540875:0:25741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788448782.541544:0:25740:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788448782.549748:0:25740:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788448782.549779:0:25740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.549798:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8052ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8052a6 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.549805:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b8052bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8052b4 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.549811:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1f800/0xf45a9e4e6b8052fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8052f3 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.549817:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1871e4000/0xf45a9e4e6b805394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80538d expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.549827:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc19e375200/0xf45a9e4e6b8055e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b8e expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.549834:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc0824fca00/0xf45a9e4e6b80561f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bfe expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.549841:0:25740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.550124:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc0824fca00/0xf45a9e4e6b80561f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bfe expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.550139:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc0824fca00/0xf45a9e4e6b80561f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bfe expref: 12 pid: 22704 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448782.550166:0:25740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484096:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448782.550277:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc19e375200/0xf45a9e4e6b8055e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b8e expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.550286:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc19e375200/0xf45a9e4e6b8055e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b8e expref: 12 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448782.550294:0:25740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484224:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448782.550341:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1871e4000/0xf45a9e4e6b805394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80538d expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.550349:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc1871e4000/0xf45a9e4e6b805394 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80538d expref: 23 pid: 22705 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448782.550359:0:25740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff04a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484352:0@lo:104: 00000100:00100000:0.0:1788448782.550407:0:25740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448782.550463:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1f800/0xf45a9e4e6b8052fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8052f3 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.550471:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc182c1f800/0xf45a9e4e6b8052fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052f3 expref: 23 pid: 22705 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448782.550479:0:25740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484480:0@lo:104: 00000100:00100000:0.0:1788448782.550501:0:25740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448782.550530:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826484352 00000100:00100000:0.0:1788448782.550537:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826484352 00000100:00100000:0.0:1788448782.550587:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826484480 00000100:00100000:0.0:1788448782.550598:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826484480 00000100:00100000:0.0:1788448782.550617:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448782.550625:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+4:25740:x1875323826484352:12345-0@lo:104: 00010000:00010000:0.0:1788448782.550637:0:22693:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.550682:0:22693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448782.550688:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+4:25740:x1875323826484352:12345-0@lo:104: Request processed in 64us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448782.550695:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448782.550715:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448782.550720:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:25740:x1875323826484480:12345-0@lo:104: 00010000:00010000:0.0:1788448782.550727:0:22693:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.550756:0:22693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788448782.550761:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:25740:x1875323826484480:12345-0@lo:104: Request processed in 41us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448782.550767:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788448782.550797:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b8052bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8052b4 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.550805:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b8052bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052b4 expref: 23 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448782.550813:0:25740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484608:0@lo:104: 00000100:00100000:0.0:1788448782.550833:0:25740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448782.550852:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826484608 00000100:00100000:0.0:1788448782.550855:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826484608 00000100:00100000:0.0:1788448782.550878:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448782.551168:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:25740:x1875323826484608:12345-0@lo:104: 00010000:00010000:0.0:1788448782.551176:0:22693:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.551205:0:22693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788448782.551210:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:25740:x1875323826484608:12345-0@lo:104: Request processed in 46us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448782.551216:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788448782.551244:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8052ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8052a6 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.551252:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8052ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052a6 expref: 23 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448782.551259:0:25740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484736:0@lo:104: 00000100:00100000:0.0:1788448782.551279:0:25740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448782.551297:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826484736 00000100:00100000:0.0:1788448782.551300:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826484736 00000100:00100000:0.0:1788448782.551315:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788448782.551320:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:25740:x1875323826484736:12345-0@lo:104: 00010000:00010000:0.0:1788448782.551327:0:22693:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.551351:0:22693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788448782.551356:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+3:25740:x1875323826484736:12345-0@lo:104: Request processed in 36us (76us total) trans 0 rc 0/0 00010000:00010000:2.0:1788448782.551466:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788448782.551479:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551486:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448782.551490:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551498:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448782.551505:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448782.551511:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448782.551544:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551550:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448782.551565:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551571:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8400/0xf45a9e4e6b80538d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b805394 expref: -99 pid: 25032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551584:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788448782.551587:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551593:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9600 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448782.551595:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551611:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448782.551617:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448782.551621:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448782.551635:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551640:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448782.551657:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551663:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9600/0xf45a9e4e6b8052f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8052fa expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551673:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448782.551676:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551681:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448782.551684:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551690:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448782.551696:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448782.551707:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448782.551721:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551726:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448782.551732:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551738:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e200/0xf45a9e4e6b8052b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8052bb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551747:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448782.551749:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551755:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448782.551757:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551763:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448782.551769:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448782.551774:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448782.551786:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551791:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448782.551803:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551810:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b8052a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8052ad expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.551822:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448782.551824:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448782.551825:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448782.551847:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826485120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448782.551897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448782.552062:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448782.552193:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448782.552200:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826484992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448782.552223:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448782.552249:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826485120 00000100:00100000:2.0:1788448782.552253:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826485120 00010000:00010000:2.0:1788448782.552274:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b8052bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052b4 expref: 24 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448782.552289:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826484992 00000100:00100000:2.0:1788448782.552292:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826484992 00010000:00010000:2.0:1788448782.552300:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1f800/0xf45a9e4e6b8052fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052f3 expref: 25 pid: 22705 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448782.552309:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448782.552314:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+25:3648:x1875323826485120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448782.552324:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448782.552328:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b8052bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052b4 expref: 25 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.552347:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b8052bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052b4 expref: 25 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448782.552727:0:25740:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc19222fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448782.552756:0:25740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff04a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484352:0@lo:104: 00000100:00100000:0.0:1788448782.552766:0:25740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484480:0@lo:104: 00010000:00010000:0.0:1788448782.552774:0:25740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1f000/0xf45a9e4e6b8052bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8052b4 expref: 25 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448782.552787:0:25740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484608:0@lo:104: 00000100:00100000:0.0:1788448782.552796:0:25740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484736:0@lo:104: 00010000:00010000:2.0:1788448782.553107:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448782.553232:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:3648:x1875323826485120:12345-0@lo:103:ldlm_bl.0 Request processed in 915us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448782.553248:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448782.553270:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448782.553278:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:3648:x1875323826484992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448782.553289:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448782.553294:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1f800/0xf45a9e4e6b8052fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052f3 expref: 23 pid: 22705 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.553302:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1f800/0xf45a9e4e6b8052fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052f3 expref: 23 pid: 22705 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.553322:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1f800/0xf45a9e4e6b8052fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8052f3 expref: 23 pid: 22705 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.553333:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448782.553355:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:3648:x1875323826484992:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1131us total) trans 0 rc 0/0 00010000:00010000:1.0:1788448782.553600:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448782.553614:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3646:1875323826484864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448782.553647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448782.553670:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448782.553676:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3646:1875323826485248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448782.553693:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448782.553717:0:22697:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788448782.553723:0:22697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788448782.553739:0:22695:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788448782.553745:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826484864 00000100:00100000:1.0:1788448782.553749:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826484864 00010000:00010000:1.0:1788448782.553768:0:22695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1871e4000/0xf45a9e4e6b805394 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80538d expref: 23 pid: 22705 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448782.553825:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826484992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448782.553835:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3648:1875323826485120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448782.553878:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448782.553997:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826485248 00000100:00100000:2.0:1788448782.554001:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826485248 00010000:00010000:2.0:1788448782.554013:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8052ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052a6 expref: 23 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448782.554648:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788448782.554659:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:3646:x1875323826484864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448782.554671:0:22695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448782.554677:0:22695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1871e4000/0xf45a9e4e6b805394 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80538d expref: 23 pid: 22705 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448782.554687:0:22695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1871e4000/0xf45a9e4e6b805394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80538d expref: 23 pid: 22705 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448782.554702:0:22695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1871e4000/0xf45a9e4e6b805394 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80538d expref: 23 pid: 22705 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448782.554744:0:22695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448782.555020:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:3646:x1875323826484864:12345-0@lo:103:ldlm_bl.0 Request processed in 362us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448782.555027:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448782.555036:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3646:1875323826484864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448782.555343:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448782.555618:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:3646:x1875323826485248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448782.555630:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448782.555636:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8052ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052a6 expref: 21 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.555645:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8052ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8052a6 expref: 21 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.555656:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8052ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8052a6 expref: 21 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.555665:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448782.555704:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:3646:x1875323826485248:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448782.555830:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448782.555862:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44e7ff6c-6b3b-4629-bf03-6edc4527824b:3646:1875323826485248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448782.557551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448782.557581:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448782.557632:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801200384 00000100:00100000:1.0:1788448782.557640:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801200384 00010000:00010000:1.0:1788448782.557674:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc0824fca00/0xf45a9e4e6b80561f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bfe expref: 13 pid: 22704 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448782.557735:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801200512 00000100:00100000:1.0:1788448782.557738:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801200512 00010000:00010000:1.0:1788448782.557750:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc19e375200/0xf45a9e4e6b8055e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b8e expref: 14 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448782.557824:0:25740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484096:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448782.557835:0:25740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875323826484224:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448782.557875:0:25740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448782.558200:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:0.0:1788448782.558212:0:25742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1aebe5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dd607f5-2bb4-4330-b02d-7405fa363325+14:2399:x1875323801200384:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448782.558227:0:25742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448782.558234:0:25742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc0824fca00/0xf45a9e4e6b80561f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bfe expref: 14 pid: 22704 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558244:0:25742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc0824fca00/0xf45a9e4e6b80561f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bfe expref: 14 pid: 22704 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558262:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fca00/0xf45a9e4e6b80561f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bfe expref: 14 pid: 22704 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558275:0:25742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448782.558348:0:25742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1aebe5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dd607f5-2bb4-4330-b02d-7405fa363325+13:2399:x1875323801200384:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 139us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448782.558356:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:0.0:1788448782.558406:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:0.0:1788448782.558413:0:25742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dd607f5-2bb4-4330-b02d-7405fa363325+12:2399:x1875323801200512:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448782.558421:0:25742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448782.558426:0:25742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc19e375200/0xf45a9e4e6b8055e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b8e expref: 12 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558435:0:25742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc19e375200/0xf45a9e4e6b8055e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b8e expref: 12 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558456:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc19e375200/0xf45a9e4e6b8055e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b8e expref: 12 pid: 22703 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558468:0:25742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558477:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558490:0:25742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558497:0:25742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558503:0:25742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558509:0:25742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558522:0:25742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330e00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448782.558526:0:25742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558533:0:25742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558547:0:25742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448782.558556:0:25742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448782.558577:0:25742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dd607f5-2bb4-4330-b02d-7405fa363325+11:2399:x1875323801200512:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 164us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448782.558584:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00010000:00010000:2.0:1788448782.559052:0:25740:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.559061:0:25740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.559067:0:25740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b805650 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448782.782035:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448783.038515:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448783.038537:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19ed04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826485376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448783.038603:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448783.038705:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826485376 00000100:00100000:0.0:1788448783.038713:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826485376 00000100:00100000:0.0:1788448783.038780:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448783.038790:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826485376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788448783.038816:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788448783.038866:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826485376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448783.038873:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448783.038985:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19ed04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826485376:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788448783.039579:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448783.553257:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19ed04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826485504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448783.553326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448783.553517:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826485504 00000100:00100000:1.0:1788448783.553526:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826485504 00000100:00100000:1.0:1788448783.553577:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788448783.553587:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826485504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448783.553619:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788448783.553677:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826485504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448783.553684:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788448783.553784:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826485632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448783.553816:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448783.553899:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826485632 00000100:00100000:1.0:1788448783.553904:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826485632 00000100:00100000:1.0:1788448783.553937:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788448783.553944:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826485632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448783.553964:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788448783.554012:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826485632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448783.554018:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788448783.554184:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19ed04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826485504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448783.554261:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826485632:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788448783.806224:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788448783.933994:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448783.934001:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc082115800 from 13 10000000:01000000:2.0:1788448783.934006:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448783.934049:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1b5254400/0xf45a9e4e6b805657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448783.934060:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1b5254400/0xf45a9e4e6b805657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448783.934071:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1b5254400/0xf45a9e4e6b805657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448783.934095:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826485760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448783.934159:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448783.934204:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18770a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788448783.934343:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826485760 00000100:00100000:0.0:1788448783.934364:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826485760 00000100:00100000:0.0:1788448783.934412:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788448783.934421:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+20:22707:x1875323826485760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448783.934450:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448783.934464:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1a0330400/0xf45a9e4e6b80565e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805657 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448783.934486:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0330400/0xf45a9e4e6b80565e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805657 expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448783.934497:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1a0330400/0xf45a9e4e6b80565e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805657 expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448783.934506:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330400, rc 0) 00000100:00100000:0.0:1788448783.934551:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:22707:x1875323826485760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448783.934560:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788448783.934703:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826485760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448783.934717:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1b5254400/0xf45a9e4e6b805657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80565e expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448783.934727:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1b5254400/0xf45a9e4e6b805657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80565e expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448783.934783:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826485888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448783.934810:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448783.934830:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18770a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448783.934908:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826485888 00000100:00100000:3.0:1788448783.934913:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826485888 00000100:00100000:3.0:1788448783.934949:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788448783.934956:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:22707:x1875323826485888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448783.935063:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:22707:x1875323826485888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448783.935070:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788448783.935231:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826485888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448783.935257:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448783.935294:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448783.935322:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18770a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788448783.935428:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826486016 00000100:00100000:1.0:1788448783.935443:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826486016 00000100:00100000:1.0:1788448783.935475:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788448783.935482:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:22707:x1875323826486016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448783.935575:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:22707:x1875323826486016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448783.935582:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788448783.935604:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788448783.936649:0:25754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788448783.940867:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788448783.940916:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448783.940932:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1b5254400/0xf45a9e4e6b805657 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80565e expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448783.940944:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1b5254400/0xf45a9e4e6b805657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80565e expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448783.940996:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448783.941000:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1a517b800 from 13 10000000:01000000:3.0:1788448783.941003:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448783.941048:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc19e374e00/0xf45a9e4e6b805665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.941073:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc19e374e00/0xf45a9e4e6b805665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.941085:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc19e374e00/0xf45a9e4e6b805665 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448783.941114:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448783.941181:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448783.941231:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082767300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448783.941666:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826486144 00000100:00100000:0.0:1788448783.941673:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826486144 00000100:00100000:0.0:1788448783.941713:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788448783.941722:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+21:22707:x1875323826486144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448783.941734:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448783.941747:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1a0331e00/0xf45a9e4e6b80566c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805665 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448783.941769:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0331e00/0xf45a9e4e6b80566c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805665 expref: 22 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448783.941780:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1a0331e00/0xf45a9e4e6b80566c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805665 expref: 22 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448783.941796:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331e00, rc 0) 00000100:00100000:0.0:1788448783.941843:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:22707:x1875323826486144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448783.941850:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788448783.942022:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448783.942036:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc19e374e00/0xf45a9e4e6b805665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80566c expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.942046:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc19e374e00/0xf45a9e4e6b805665 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80566c expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448783.942098:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448783.942123:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448783.942156:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082767300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448783.942207:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826486272 00000100:00100000:0.0:1788448783.942212:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826486272 00000100:00100000:0.0:1788448783.942230:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788448783.942236:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:22707:x1875323826486272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448783.942371:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:22707:x1875323826486272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448783.942378:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788448783.943205:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448783.943246:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448783.943738:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448783.943828:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082767300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448783.943866:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826486400 00000100:00100000:0.0:1788448783.943872:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826486400 00000100:00100000:0.0:1788448783.943977:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788448783.943985:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:22707:x1875323826486400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448783.944128:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:22707:x1875323826486400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448783.944135:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788448783.944705:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788448783.946204:0:25755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788448783.946608:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788448783.946644:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448783.946655:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc19e374e00/0xf45a9e4e6b805665 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80566c expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.946667:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc19e374e00/0xf45a9e4e6b805665 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80566c expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448783.946679:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448783.946682:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc083f6a800 from 13 10000000:01000000:3.0:1788448783.946685:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448783.946718:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc19e375a00/0xf45a9e4e6b805673 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.946728:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc19e375a00/0xf45a9e4e6b805673 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.946739:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc19e375a00/0xf45a9e4e6b805673 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448783.946761:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448783.946830:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448783.946875:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082767300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448783.947069:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826486528 00000100:00100000:0.0:1788448783.947077:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826486528 00000100:00100000:0.0:1788448783.947152:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788448783.947163:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+22:22707:x1875323826486528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448783.947175:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448783.947187:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1a0331400/0xf45a9e4e6b80567a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805673 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448783.947217:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0331400/0xf45a9e4e6b80567a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805673 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448783.947228:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1a0331400/0xf45a9e4e6b80567a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805673 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448783.947237:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331400, rc 0) 00000100:00100000:0.0:1788448783.947287:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:22707:x1875323826486528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448783.947294:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788448783.947391:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff60e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448783.947405:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc19e375a00/0xf45a9e4e6b805673 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80567a expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448783.947415:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc19e375a00/0xf45a9e4e6b805673 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80567a expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448783.947480:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19ed07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448783.947507:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448783.954563:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448783.954663:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826486656 00000100:00100000:3.0:1788448783.954673:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826486656 00000100:00100000:3.0:1788448783.954724:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788448783.954733:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:22707:x1875323826486656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448783.954898:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:22707:x1875323826486656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (7389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448783.954905:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788448783.955034:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19ed07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448783.955079:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19ed07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448783.955132:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448783.955153:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448783.960781:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826486784 00000100:00100000:0.0:1788448783.960796:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826486784 00000100:00100000:0.0:1788448783.960856:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788448783.960866:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:22707:x1875323826486784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448783.961040:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:22707:x1875323826486784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (5907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448783.961050:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788448783.961184:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19ed07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788448783.965462:0:25756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788448783.965693:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788448783.965719:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448783.965729:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc19e375a00/0xf45a9e4e6b805673 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80567a expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.965741:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc19e375a00/0xf45a9e4e6b805673 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80567a expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448783.965752:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448783.965754:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1bfee5000 from 13 10000000:01000000:3.0:1788448783.965757:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448783.965792:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc19e374400/0xf45a9e4e6b805681 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.965800:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc19e374400/0xf45a9e4e6b805681 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.965812:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc19e374400/0xf45a9e4e6b805681 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448783.965835:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448783.965933:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448783.965975:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082767000 going to sleep for 11 seconds 00000100:00100000:2.0:1788448783.968600:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826486912 00000100:00100000:2.0:1788448783.968612:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826486912 00000100:00100000:2.0:1788448783.968918:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788448783.968933:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+23:22707:x1875323826486912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448783.968949:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448783.968966:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1b5254c00/0xf45a9e4e6b805688 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b805681 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448783.968992:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1b5254c00/0xf45a9e4e6b805688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b805681 expref: 24 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448783.969002:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1b5254c00/0xf45a9e4e6b805688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b805681 expref: 24 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448783.969010:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1b5254c00, rc 0) 00000100:00100000:2.0:1788448783.969094:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:22707:x1875323826486912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (3161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448783.969100:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788448783.969181:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826486912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448783.969200:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc19e374400/0xf45a9e4e6b805681 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805688 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448783.969209:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc19e374400/0xf45a9e4e6b805681 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b805688 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448783.969282:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826487040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448783.969324:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448783.969367:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc19222f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448783.969416:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826487040 00000100:00100000:3.0:1788448783.969420:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826487040 00000100:00100000:3.0:1788448783.969453:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788448783.969460:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:22707:x1875323826487040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448783.969568:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:22707:x1875323826487040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448783.969575:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788448783.969640:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826487040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448783.969667:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826487168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448783.969710:0:22707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448783.969749:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826487168 00000100:00100000:3.0:1788448783.969752:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826487168 00000100:00100000:3.0:1788448783.969768:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788448783.969772:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:22707:x1875323826487168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448783.969836:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc19222f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448783.969982:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44e7ff6c-6b3b-4629-bf03-6edc4527824b+24:22707:x1875323826487168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448783.970032:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44e7ff6c-6b3b-4629-bf03-6edc4527824b:22707:1875323826487168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448783.970109:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000040:00080000:3.0:1788448783.973355:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788448783.973550:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788448783.973574:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448783.973584:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc19e374400/0xf45a9e4e6b805681 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805688 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448783.973594:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc19e374400/0xf45a9e4e6b805681 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b805688 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448783.974028:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448783.974099:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801200640 00000100:00100000:3.0:1788448783.974107:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801200640 00000100:00100000:3.0:1788448783.974145:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 159 00000100:00100000:3.0:1788448783.974154:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+11:18073:x1875323801200640:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448783.974168:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448783.974183:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc19e374c00/0xf45a9e4e6b80568f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c36 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.974207:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc19e374c00/0xf45a9e4e6b80568f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c36 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.974217:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc19e374c00/0xf45a9e4e6b80568f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c36 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448783.974226:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc19e374c00, rc 0) 00000100:00100000:3.0:1788448783.974308:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+12:18073:x1875323801200640:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 154us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448783.974316:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 159 00000100:00100000:2.0:1788448783.981173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448783.981262:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801200768 00000100:00100000:3.0:1788448783.981272:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801200768 00000100:00100000:3.0:1788448783.981340:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 160 00000100:00100000:3.0:1788448783.981349:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+12:18073:x1875323801200768:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448783.981509:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+12:18073:x1875323801200768:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 160us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448783.981517:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 160 00000100:00100000:0.0:1788448783.985211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448783.988211:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801200896 00000100:00100000:2.0:1788448783.988224:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801200896 00000100:00100000:2.0:1788448783.988315:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 161 00000100:00100000:2.0:1788448783.988325:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+12:18073:x1875323801200896:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448783.988513:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+12:18073:x1875323801200896:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 188us (3309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448783.988522:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 161 00000100:00100000:0.0:1788448784.008250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.008345:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801201024 00000100:00100000:1.0:1788448784.008355:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801201024 00000100:00100000:1.0:1788448784.008403:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 162 00000100:00100000:1.0:1788448784.008413:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+12:18073:x1875323801201024:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448784.008428:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448784.008456:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fd200/0xf45a9e4e6b805696 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c3d expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.008484:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fd200/0xf45a9e4e6b805696 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c3d expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.008495:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fd200/0xf45a9e4e6b805696 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c3d expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.008504:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd200, rc 0) 00000100:00100000:1.0:1788448784.008569:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18073:x1875323801201024:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 158us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448784.008576:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 162 00000100:00100000:0.0:1788448784.011420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448784.011514:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801201152 00000100:00100000:2.0:1788448784.011523:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801201152 00000100:00100000:2.0:1788448784.011585:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 163 00000100:00100000:2.0:1788448784.011595:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18073:x1875323801201152:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448784.011726:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18073:x1875323801201152:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 132us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448784.011734:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 163 00000100:00100000:0.0:1788448784.016175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448784.016324:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801201280 00000100:00100000:3.0:1788448784.016337:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801201280 00000100:00100000:3.0:1788448784.016407:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00100000:3.0:1788448784.016419:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18073:x1875323801201280:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448784.016620:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dd607f5-2bb4-4330-b02d-7405fa363325+13:18073:x1875323801201280:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 202us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.016629:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00100000:0.0:1788448784.042247:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448784.042515:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801201408 00000100:00100000:3.0:1788448784.042530:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801201408 00000100:00100000:3.0:1788448784.042776:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:3.0:1788448784.042791:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:18696:x1875323801201408:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448784.042819:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448784.042850:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b80569d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c44 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.042984:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8056a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043001:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8056a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043015:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8056a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043050:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b8056ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043057:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b8056ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043064:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b8056ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043165:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e374200/0xf45a9e4e6b8056b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043174:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e374200/0xf45a9e4e6b8056b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043182:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e374200/0xf45a9e4e6b8056b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448784.043218:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788448784.043222:0:22712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448784.043263:0:22712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e374200/0xf45a9e4e6b8056b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043275:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8056a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043282:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8056a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043289:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8056a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043306:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448784.043312:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8056a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043634:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8056a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043649:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc189117000) 00010000:00010000:3.0:1788448784.043652:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448784.043658:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8056a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043664:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8056a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043678:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b8056ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043685:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b8056ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043691:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b8056ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043695:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448784.043698:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b8056ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043704:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b8056ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043722:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fc1bb42a500) 00010000:00010000:3.0:1788448784.043724:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448784.043727:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b8056ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043733:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b8056ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043769:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b80569d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c44 expref: 8 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043782:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e374200/0xf45a9e4e6b8056b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c44 expref: 7 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.043790:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc1bb42af00) 00010000:00010000:3.0:1788448784.043792:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448784.043795:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc19e374200, rc 0) 00000100:00080000:1.0:1788448784.044267:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448784.044577:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:18696:x1875323801201408:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1786us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448784.044588:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:0.0:1788448784.050467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448784.051039:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801201536 00000100:00100000:3.0:1788448784.051052:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801201536 00000100:00100000:3.0:1788448784.051132:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:3.0:1788448784.051145:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:18696:x1875323801201536:12345-192.168.206.21@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788448784.051255:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:18696:x1875323801201536:12345-192.168.206.21@tcp:900:lhsmtool_posix.0 Request processed in 112us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.051264:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:0.0:1788448784.054527:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.054649:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801201792 00000100:00100000:1.0:1788448784.054662:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801201792 00000100:00100000:1.0:1788448784.054735:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:1.0:1788448784.054748:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:18696:x1875323801201792:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448784.054776:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448784.054802:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8056b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c4b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055345:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055364:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055379:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055396:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055404:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055412:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055556:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b8056ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055565:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b8056ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055572:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b8056ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448784.055583:0:22710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788448784.055799:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055818:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055825:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055831:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fdc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448784.055837:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055846:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055860:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc1bb42af00) 00010000:00010000:1.0:1788448784.055863:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448784.055901:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055909:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055924:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055931:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055937:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055942:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fca00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448784.055951:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055957:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055966:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fc08336b900) 00010000:00010000:1.0:1788448784.055969:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448784.055972:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.055978:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.061669:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8056b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c4b expref: 10 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.061704:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b8056ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c4b expref: 9 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.061715:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc08336bb00) 00010000:00010000:1.0:1788448784.061718:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448784.061722:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd400, rc 0) 00000100:00100000:1.0:1788448784.061825:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+9:18696:x1875323801201792:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 7078us (7312us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788448784.061836:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:2.0:1788448784.076230:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.076999:0:25612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801201920 00000100:00100000:0.0:1788448784.077016:0:25612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801201920 00000100:00100000:0.0:1788448784.077113:0:25612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:0.0:1788448784.077127:0:25612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+9:18696:x1875323801201920:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788448784.077280:0:25612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+9:18696:x1875323801201920:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 Request processed in 156us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448784.077309:0:25612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:3.0:1788448784.083664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448784.083962:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801202048 00000100:00100000:2.0:1788448784.083975:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801202048 00000100:00100000:2.0:1788448784.084069:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:2.0:1788448784.084082:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:18696:x1875323801202048:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788448784.084239:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788448784.085974:0:22712:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1813us 00000100:00100000:2.0:1788448784.099025:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.099142:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801202176 00000100:00100000:1.0:1788448784.099153:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801202176 00000100:00100000:1.0:1788448784.099217:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:1.0:1788448784.099240:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+9:18702:x1875323801202176:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448784.099267:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448784.099293:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8056dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c52 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.099376:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.099394:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.099408:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.101818:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.101925:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.101940:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.101989:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.101997:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102003:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102086:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fca00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448784.102091:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102098:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102110:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc189117000) 00010000:00010000:1.0:1788448784.102113:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448784.102118:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102124:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8056e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102139:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102145:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102150:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102155:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fdc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448784.102158:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102164:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102183:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc08336b900) 00010000:00010000:1.0:1788448784.102185:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448784.102188:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102194:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8056ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102237:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8056dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c52 expref: 10 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102248:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc189117000) 00010000:00010000:1.0:1788448784.102250:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448784.102253:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8056dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c52 expref: 10 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.102262:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd800, rc 0) 00000100:00100000:1.0:1788448784.102323:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+9:18702:x1875323801202176:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 3086us (3312us total) trans 0 rc 301/301 00000100:00100000:1.0:1788448784.102332:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:3.0:1788448784.106705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.106854:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801202304 00000100:00100000:1.0:1788448784.106867:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801202304 00000100:00100000:1.0:1788448784.106972:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:1.0:1788448784.106987:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+9:18702:x1875323801202304:12345-192.168.206.21@tcp:700:lfs.0 00000100:00100000:1.0:1788448784.107104:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+9:18702:x1875323801202304:12345-192.168.206.21@tcp:700:lfs.0 Request processed in 120us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448784.107113:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:2.0:1788448784.114612:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448784.114794:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801202560 00000100:00100000:3.0:1788448784.114816:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801202560 00000100:00100000:2.0:1788448784.115030:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:2.0:1788448784.115045:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+9:18702:x1875323801202560:12345-192.168.206.21@tcp:36:lfs.0 00010000:00010000:2.0:1788448784.115137:0:25156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448784.115176:0:25156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80560a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0bbf expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.115199:0:25156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc189117000) 00010000:00010000:2.0:1788448784.115205:0:25156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448784.115405:0:25156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.115422:0:25156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c2f expref: 5 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.115439:0:25156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.115480:0:25156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c2f expref: 5 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.115496:0:25156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c2f expref: 5 pid: 22712 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448784.115512:0:25156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25156:1875323826487296:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448784.115609:0:25156:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18770a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448784.118838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.118920:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801202688 00000100:00100000:1.0:1788448784.118932:0:25742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801202688 00010000:00010000:1.0:1788448784.119001:0:25742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c2f expref: 6 pid: 22712 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448784.119041:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:1.0:1788448784.119051:0:25742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:2399:x1875323801202688:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448784.119067:0:25742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448784.119075:0:25742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c2f expref: 6 pid: 22712 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.119091:0:25742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c2f expref: 6 pid: 22712 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.119119:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc189117000) 00010000:00010000:1.0:1788448784.119125:0:25742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.119145:0:25742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.119155:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.119179:0:25742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448784.119244:0:25742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:2399:x1875323801202688:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 193us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448784.119253:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00080000:3.0:1788448784.120058:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788448784.125603:0:25156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805649 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c2f expref: 5 pid: 22712 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448784.125632:0:25156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25156:1875323826487296:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448784.125663:0:25156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.125674:0:25156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.125680:0:25156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.125723:0:25156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.125738:0:25156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.125751:0:25156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448784.128728:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:18696:x1875323801202048:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 Request processed in 44633us (45065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448784.128747:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00010000:00010000:2.0:1788448784.130093:0:25156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130133:0:25156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130147:0:25156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448784.130168:0:25156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c6c4de9 reply state 00000000b807639f transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130187:0:25156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130196:0:25156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc1ba209300) 00010000:00010000:2.0:1788448784.130199:0:25156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448784.130204:0:25156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788448784.130209:0:25156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788448784.130219:0:25156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130225:0:25156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130232:0:25156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130238:0:25156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448784.130243:0:25156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130252:0:25156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130275:0:25156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc189117000) 00010000:00010000:2.0:1788448784.130278:0:25156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448784.130282:0:25156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130288:0:25156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8056f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448784.130323:0:25156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c6c4de9 reply state 00000000b807639f transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130333:0:25156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.130340:0:25156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc1ba209600) 00010000:00010000:2.0:1788448784.130343:0:25156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448784.130345:0:25156:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788448784.130442:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+10:18702:x1875323801202560:12345-192.168.206.21@tcp:36:lfs.0 Request processed in 15390us (15830us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788448784.130451:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:1.0:1788448784.212135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448784.212448:0:25612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801202816 00000100:00100000:2.0:1788448784.212461:0:25612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801202816 00000100:00100000:2.0:1788448784.212538:0:25612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:2.0:1788448784.212550:0:25612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+10:18710:x1875323801202816:12345-192.168.206.21@tcp:101:lctl.0 00010000:00010000:2.0:1788448784.212581:0:25612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448784.212611:0:25612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b805706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c59 expref: -99 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.212700:0:25612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254800/0xf45a9e4e6b80570d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.212717:0:25612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254800/0xf45a9e4e6b80570d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.212732:0:25612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254800/0xf45a9e4e6b80570d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448784.212978:0:25612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788448784.212983:0:25612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448784.213031:0:25612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254800/0xf45a9e4e6b80570d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.213062:0:25612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b805706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c59 expref: 12 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.213084:0:25612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254800/0xf45a9e4e6b80570d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c59 expref: 11 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.213095:0:25612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1ba209f00) 00010000:00010000:2.0:1788448784.213099:0:25612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448784.213104:0:25612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1b5254800, rc 0) 00000100:00100000:2.0:1788448784.213247:0:25612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+11:18710:x1875323801202816:12345-192.168.206.21@tcp:101:lctl.0 Request processed in 698us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448784.213256:0:25612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:1.0:1788448784.236974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.237025:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.237044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.237080:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.237106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448784.237188:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801203072 00000100:00100000:3.0:1788448784.237200:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801203072 00000100:00100000:3.0:1788448784.237279:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801203328 00000100:00100000:3.0:1788448784.237283:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801203328 00000100:00100000:3.0:1788448784.237298:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801202944 00000100:00100000:3.0:1788448784.237301:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801202944 00000100:00100000:3.0:1788448784.237313:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801203456 00000100:00100000:3.0:1788448784.237316:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801203456 00000100:00100000:3.0:1788448784.237349:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:3.0:1788448784.237361:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2401:x1875323801203072:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448784.237468:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2401:x1875323801203072:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 108us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.237477:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:3.0:1788448784.237496:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:3.0:1788448784.237503:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2401:x1875323801203328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448784.237528:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2401:x1875323801203328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.237534:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:3.0:1788448784.237547:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:3.0:1788448784.237553:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2401:x1875323801202944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448784.237575:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2401:x1875323801202944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 22us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.237581:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:3.0:1788448784.237592:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:3.0:1788448784.237618:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2401:x1875323801203456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448784.237644:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2401:x1875323801203456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.237650:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:3.0:1788448784.237672:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801203200 00000100:00100000:3.0:1788448784.237675:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801203200 00000100:00100000:3.0:1788448784.237707:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:3.0:1788448784.237714:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2401:x1875323801203200:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448784.237743:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:2401:x1875323801203200:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.237749:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00080000:1.0:1788448784.238418:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448784.238426:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448784.238459:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788448784.239659:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448784.239760:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801203584 00000100:00100000:2.0:1788448784.239770:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801203584 00000100:00100000:2.0:1788448784.239840:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:2.0:1788448784.239852:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:18711:x1875323801203584:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448784.239915:0:25156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448784.239942:0:25156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b805714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c60 expref: -99 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.240030:0:25156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255600/0xf45a9e4e6b80571b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.240066:0:25156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255600/0xf45a9e4e6b80571b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.240080:0:25156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255600/0xf45a9e4e6b80571b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448784.240139:0:25156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788448784.240144:0:25156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448784.240168:0:25156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255600/0xf45a9e4e6b80571b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.240196:0:25156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b805714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c60 expref: 7 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.240218:0:25156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255600/0xf45a9e4e6b80571b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c60 expref: 6 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.240227:0:25156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1ba209f00) 00010000:00010000:2.0:1788448784.240231:0:25156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448784.240235:0:25156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1b5255600, rc 0) 00000100:00100000:2.0:1788448784.240294:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:18711:x1875323801203584:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 445us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448784.240303:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:3.0:1788448784.242767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.242870:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801203712 00000100:00100000:1.0:1788448784.242924:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801203712 00000100:00100000:1.0:1788448784.242994:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:1.0:1788448784.243007:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+6:18711:x1875323801203712:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448784.243033:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448784.243058:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b805722 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c67 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243319:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805729 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243408:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805729 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243423:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805729 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243446:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b805730 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243455:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b805730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243484:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b805730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243582:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805737 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243591:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805737 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243599:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805737 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448784.243645:0:22710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788448784.243649:0:22710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448784.243677:0:22710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805737 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243692:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805729 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243699:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805729 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243706:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805729 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243713:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448784.243718:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805729 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243726:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805729 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243748:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1ba209f00) 00010000:00010000:1.0:1788448784.243752:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448784.243758:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805729 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243764:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805729 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243779:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b805730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243785:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b805730 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243791:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b805730 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243797:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fdc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448784.243800:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b805730 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243806:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b805730 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243813:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc1ba209600) 00010000:00010000:1.0:1788448784.243816:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448784.243819:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b805730 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243825:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b805730 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243866:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b805722 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c67 expref: 8 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243879:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805737 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c67 expref: 7 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.243909:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc1ba209300) 00010000:00010000:1.0:1788448784.243911:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448784.243914:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd600, rc 0) 00000100:00100000:1.0:1788448784.244047:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+7:18711:x1875323801203712:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1043us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448784.244056:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:1.0:1788448784.246610:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448784.246727:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801203840 00000100:00100000:3.0:1788448784.246739:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801203840 00000100:00100000:3.0:1788448784.247112:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:3.0:1788448784.247125:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:18711:x1875323801203840:12345-192.168.206.21@tcp:900:lfs.0 00000100:00100000:3.0:1788448784.247233:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+5:18711:x1875323801203840:12345-192.168.206.21@tcp:900:lfs.0 Request processed in 111us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.247242:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:3.0:1788448784.251185:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.251442:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801204096 00000100:00100000:0.0:1788448784.251454:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801204096 00000100:00100000:0.0:1788448784.251526:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:0.0:1788448784.251537:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+7:18711:x1875323801204096:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448784.251563:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448784.251588:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b80573e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c6e expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448784.251728:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788448784.251868:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b80573e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c6e expref: 9 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.251909:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1ba209f00) 00010000:00010000:0.0:1788448784.251912:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448784.251919:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b80573e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c6e expref: 9 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.251936:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331000, rc 0) 00000100:00100000:0.0:1788448784.252009:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d299c3e-f97f-4c06-8a39-fe013752bf2d+8:18711:x1875323801204096:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 473us (837us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788448784.252017:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00000040:00080000:2.0:1788448784.254567:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788448784.259289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.262539:0:25612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801204352 00000100:00100000:0.0:1788448784.262558:0:25612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801204352 00000100:00100000:0.0:1788448784.262645:0:25612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:0.0:1788448784.262657:0:25612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d299c3e-f97f-4c06-8a39-fe013752bf2d+8:18711:x1875323801204352:12345-192.168.206.21@tcp:36:lfs.0 00010000:00010000:0.0:1788448784.262724:0:25612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448784.262758:0:25612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b805737 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c67 expref: 8 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.262783:0:25612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc1ba209300) 00010000:00010000:0.0:1788448784.262788:0:25612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448784.262813:0:25612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.262827:0:25612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.262838:0:25612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448784.264502:0:25612:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ea43aa8 reply state 00000000482e202a transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.264530:0:25612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.264539:0:25612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc1ba209300) 00010000:00010000:0.0:1788448784.264542:0:25612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788448784.264546:0:25612:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788448784.264558:0:25612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788448784.264725:0:25612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d299c3e-f97f-4c06-8a39-fe013752bf2d+9:18711:x1875323801204352:12345-192.168.206.21@tcp:36:lfs.0 Request processed in 2066us (5449us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788448784.264750:0:25612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:3.0:1788448784.274488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448784.274580:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801204608 00000100:00100000:2.0:1788448784.274594:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801204608 00000100:00100000:2.0:1788448784.274679:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:2.0:1788448784.274690:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+9:18711:x1875323801204608:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1788448784.275059:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+10:18711:x1875323801204608:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 369us (584us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788448784.275068:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:3.0:1788448784.283199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.283377:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801204864 00000100:00100000:1.0:1788448784.283391:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801204864 00000100:00100000:1.0:1788448784.283484:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:1.0:1788448784.283496:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+10:18711:x1875323801204864:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448784.283527:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448784.283689:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b805753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c75 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.283931:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b80575a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.283948:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b80575a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.283985:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b80575a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.283999:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805761 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.284008:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805761 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.284015:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805761 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448784.284486:0:22710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788448784.284663:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b80575a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.284673:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b80575a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.284679:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b80575a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.284685:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fdc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448784.284690:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b80575a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.284698:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b80575a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.284936:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1ba209f00) 00010000:00010000:1.0:1788448784.284940:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448784.284958:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b80575a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.284965:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b80575a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.284981:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805761 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.284989:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805761 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.284995:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805761 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.285000:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448784.285003:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805761 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.285008:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805761 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.285017:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc1ba209600) 00010000:00010000:1.0:1788448784.285020:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448784.285268:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805761 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.285278:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805761 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.285396:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b805753 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c75 expref: 12 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.285420:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1ba209f00) 00010000:00010000:1.0:1788448784.285422:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448784.285427:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b805753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c75 expref: 12 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.285448:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fca00, rc 0) 00000100:00100000:1.0:1788448784.286004:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+11:18711:x1875323801204864:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 2506us (2815us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1788448784.286017:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:2.0:1788448784.291565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448784.291655:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801204992 00000100:00100000:3.0:1788448784.291668:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801204992 00000100:00100000:3.0:1788448784.291740:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:3.0:1788448784.291770:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d299c3e-f97f-4c06-8a39-fe013752bf2d+11:18711:x1875323801204992:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448784.291800:0:25156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448784.291825:0:25156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b80576f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c7c expref: -99 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.292100:0:25156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.292117:0:25156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.292130:0:25156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448784.292157:0:25156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788448784.292161:0:25156:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448784.292182:0:25156:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.292211:0:25156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b80576f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c7c expref: 13 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.292229:0:25156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c7c expref: 12 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.292239:0:25156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc1ba209300) 00010000:00010000:3.0:1788448784.292242:0:25156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448784.292247:0:25156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc19e375600, rc 0) 00000100:00100000:3.0:1788448784.292540:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d299c3e-f97f-4c06-8a39-fe013752bf2d+12:18711:x1875323801204992:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 771us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.292559:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:3.0:1788448784.296253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448784.296461:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801205120 00000100:00100000:2.0:1788448784.296473:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801205120 00000100:00100000:2.0:1788448784.296543:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:2.0:1788448784.296555:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+12:18711:x1875323801205120:12345-192.168.206.21@tcp:37:lfs.0 00000100:00100000:2.0:1788448784.301657:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d299c3e-f97f-4c06-8a39-fe013752bf2d+12:18711:x1875323801205120:12345-192.168.206.21@tcp:37:lfs.0 Request processed in 5089us (5403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448784.301673:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:3.0:1788448784.305289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.305477:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801205376 00000100:00100000:1.0:1788448784.305489:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801205376 00000100:00100000:1.0:1788448784.305558:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:1.0:1788448784.305572:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1aeb57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+12:18711:x1875323801205376:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:1.0:1788448784.305921:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1aeb57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+13:18711:x1875323801205376:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 314us (608us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788448784.305929:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:3.0:1788448784.355873:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.356124:0:25612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801205504 00000100:00100000:0.0:1788448784.356145:0:25612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801205504 00000100:00100000:0.0:1788448784.356222:0:25612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:0.0:1788448784.356235:0:25612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+11:18717:x1875323801205504:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1788448784.356262:0:25612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448784.356298:0:25612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b80577d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c83 expref: -99 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356388:0:25612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805784 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356405:0:25612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805784 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356418:0:25612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805784 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356440:0:25612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80578b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356448:0:25612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80578b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356455:0:25612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80578b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356563:0:25612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b805792 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356595:0:25612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b805792 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356604:0:25612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b805792 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448784.356649:0:25612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788448784.356652:0:25612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448784.356702:0:25612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b805792 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356717:0:25612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805784 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356725:0:25612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805784 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356731:0:25612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805784 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356738:0:25612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448784.356743:0:25612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805784 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356752:0:25612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805784 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356767:0:25612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1ba209f00) 00010000:00010000:0.0:1788448784.356771:0:25612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448784.356777:0:25612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356795:0:25612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b805784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356813:0:25612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80578b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356820:0:25612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80578b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356826:0:25612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80578b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356842:0:25612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448784.356846:0:25612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80578b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356852:0:25612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80578b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356860:0:25612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc1ba209600) 00010000:00010000:0.0:1788448784.356863:0:25612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448784.356866:0:25612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80578b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356872:0:25612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80578b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356961:0:25612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b80577d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c83 expref: 13 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356989:0:25612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b805792 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c83 expref: 12 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.356999:0:25612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc1ba209300) 00010000:00010000:0.0:1788448784.357002:0:25612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788448784.357005:0:25612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330200, rc 0) 00000100:00100000:0.0:1788448784.357086:0:25612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+12:18717:x1875323801205504:12345-192.168.206.21@tcp:101:bash.0 Request processed in 852us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448784.357095:0:25612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:3.0:1788448784.361018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.361444:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801205632 00000100:00100000:0.0:1788448784.361457:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801205632 00000100:00100000:0.0:1788448784.361524:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1788448784.361536:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:18717:x1875323801205632:12345-192.168.206.21@tcp:900:bash.0 00000100:00100000:0.0:1788448784.361645:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:18717:x1875323801205632:12345-192.168.206.21@tcp:900:bash.0 Request processed in 111us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448784.361654:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:3.0:1788448784.364081:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.364183:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801205888 00000100:00100000:1.0:1788448784.364194:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801205888 00000100:00100000:1.0:1788448784.364261:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:1.0:1788448784.364272:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+12:18717:x1875323801205888:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448784.364296:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448784.364383:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805799 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c8a expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.364539:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.364575:0:22710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c7c expref: 12 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.364586:0:22710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.364631:0:22710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c7c expref: 12 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.364648:0:22710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c7c expref: 12 pid: 25156 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448784.364665:0:22710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19ed07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22710:1875323826487424:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448784.364862:0:22710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788448784.368200:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.368323:0:22710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19ed07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22710:1875323826487424:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448784.368358:0:22710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448784.368590:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801206016 00000100:00100000:2.0:1788448784.368599:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801206016 00010000:00010000:2.0:1788448784.368649:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c7c expref: 13 pid: 25156 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448784.368693:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:2.0:1788448784.368705:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+13:2399:x1875323801206016:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448784.368722:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448784.368730:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c7c expref: 13 pid: 25156 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.368744:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c7c expref: 13 pid: 25156 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.368771:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375600/0xf45a9e4e6b805776 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c7c expref: 13 pid: 25156 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.369108:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc1ba209300) 00010000:00010000:2.0:1788448784.369116:0:22696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.369128:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.369141:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.369184:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448784.369209:0:22710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.369221:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448784.369254:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d299c3e-f97f-4c06-8a39-fe013752bf2d+12:2399:x1875323801206016:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 546us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448784.369265:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00010000:00010000:0.0:1788448784.369272:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.369299:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.369317:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370053:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8057ae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370065:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8057ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370074:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8057ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448784.370087:0:22710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788448784.370122:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370131:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370139:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370146:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fdc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448784.370151:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370174:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370187:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc1ba209300) 00010000:00010000:0.0:1788448784.370191:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448784.370195:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370203:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b8057a0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448784.370217:0:22710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e9ddbc6 reply state 00000000ac80d56d transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370229:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370236:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fc189117e00) 00010000:00010000:0.0:1788448784.370238:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788448784.370241:0:22710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788448784.370285:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b805799 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c8a expref: 15 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370416:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8057ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c8a expref: 14 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.370436:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:0.0:1788448784.370439:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788448784.370442:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331000, rc 0) 00000100:00100000:0.0:1788448784.370513:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+15:18717:x1875323801205888:12345-192.168.206.21@tcp:101:bash.0 Request processed in 6241us (6444us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788448784.370523:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:0.0:1788448784.396518:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448784.396625:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801206144 00000100:00100000:3.0:1788448784.396640:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801206144 00000100:00100000:3.0:1788448784.396766:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:3.0:1788448784.396778:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+15:18717:x1875323801206144:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1788448784.396802:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448784.396823:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8057bc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c91 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.396934:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.396947:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.396958:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448784.397003:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788448784.397007:0:22711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448784.397028:0:22711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.397038:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.397077:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8057bc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c91 expref: 17 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.397094:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c91 expref: 16 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.397103:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:3.0:1788448784.397106:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448784.397110:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc19e375400, rc 0) 00000100:00100000:3.0:1788448784.397171:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+16:18717:x1875323801206144:12345-192.168.206.21@tcp:101:bash.0 Request processed in 395us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.397178:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:3.0:1788448784.399795:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.400199:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801206400 00000100:00100000:1.0:1788448784.400213:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801206400 00000100:00100000:1.0:1788448784.400370:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:1.0:1788448784.400384:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+16:18717:x1875323801206400:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:1.0:1788448784.400789:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+17:18717:x1875323801206400:12345-192.168.206.21@tcp:35:bash.0 Request processed in 406us (1008us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788448784.400798:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:1.0:1788448784.491353:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448784.491489:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801206656 00000100:00100000:2.0:1788448784.491501:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801206656 00000100:00100000:2.0:1788448784.491577:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:2.0:1788448784.491589:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+17:18727:x1875323801206656:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448784.491620:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448784.491647:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c98 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448784.491782:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788448784.491962:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c98 expref: 19 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.491978:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1ba209f00) 00010000:00010000:2.0:1788448784.491998:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448784.492004:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c98 expref: 19 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.492022:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1b5255c00, rc 0) 00000100:00100000:2.0:1788448784.492096:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+18:18727:x1875323801206656:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 508us (755us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1788448784.492103:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:0.0:1788448784.494648:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448784.494821:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801206912 00000100:00100000:2.0:1788448784.494831:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801206912 00000100:00100000:2.0:1788448784.494919:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:2.0:1788448784.494931:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+18:18727:x1875323801206912:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1788448784.495158:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+19:18727:x1875323801206912:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 228us (520us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788448784.495177:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:3.0:1788448784.574865:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826487552:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.574947:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.574977:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826488064:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.574997:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.575010:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba2db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826488576:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575033:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.575055:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788448784.575060:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826487680:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.575101:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826488192:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.575137:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba2daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826488704:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.575225:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826487808:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.575275:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826488320:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.575320:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba2d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826488832:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575340:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.575360:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788448784.575365:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826487936:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.575398:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba2d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826488448:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575416:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.575439:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba2d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826488960:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575459:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448784.575482:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826487680 00000100:00100000:3.0:1788448784.575489:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826487680 00000100:00100000:3.0:1788448784.575532:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826488192 00000100:00100000:3.0:1788448784.575536:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826488192 00000100:00100000:3.0:1788448784.575548:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826487808 00000100:00100000:3.0:1788448784.575550:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826487808 00000100:00100000:3.0:1788448784.575562:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826488320 00000100:00100000:3.0:1788448784.575564:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826488320 00000100:00100000:3.0:1788448784.575579:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788448784.575587:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826487680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575638:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826487680:12345-0@lo:400:kworker.0 Request processed in 51us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.575645:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788448784.575669:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788448784.575676:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826488192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575707:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826488192:12345-0@lo:400:kworker.0 Request processed in 32us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.575713:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788448784.575724:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448784.575731:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826487808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575775:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826487808:12345-0@lo:400:kworker.0 Request processed in 45us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.575782:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448784.575794:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448784.575801:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826488320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575826:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826488320:12345-0@lo:400:kworker.0 Request processed in 26us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.575832:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448784.575866:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826487680:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575877:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826488192:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575932:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826487808:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575942:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826488320:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.575966:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826488576 00000100:00100000:3.0:1788448784.575970:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826488576 00000100:00100000:3.0:1788448784.575993:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826488704 00000100:00100000:3.0:1788448784.575996:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826488704 00000100:00100000:3.0:1788448784.576007:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826488832 00000100:00100000:3.0:1788448784.576010:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826488832 00000100:00100000:3.0:1788448784.576033:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826487936 00000100:00100000:3.0:1788448784.576037:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826487936 00000100:00100000:3.0:1788448784.576047:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826488448 00000100:00100000:3.0:1788448784.576050:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826488448 00000100:00100000:3.0:1788448784.576061:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826488960 00000100:00100000:3.0:1788448784.576064:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826488960 00000100:00100000:3.0:1788448784.576079:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448784.576086:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826488576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.576122:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826488576:12345-0@lo:400:kworker.0 Request processed in 37us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.576129:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448784.576141:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448784.576148:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826488704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.576176:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826488704:12345-0@lo:400:kworker.0 Request processed in 29us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.576181:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448784.576193:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448784.576199:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826488832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.576228:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826488832:12345-0@lo:400:kworker.0 Request processed in 30us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.576234:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448784.576246:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788448784.576252:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826487936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.576278:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826487936:12345-0@lo:400:kworker.0 Request processed in 26us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.576283:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788448784.576294:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788448784.576306:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826488448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.576335:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826488448:12345-0@lo:400:kworker.0 Request processed in 30us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.576340:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788448784.576352:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788448784.576358:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826488960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.576382:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826488960:12345-0@lo:400:kworker.0 Request processed in 25us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.576388:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788448784.576412:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba2daa00 x1875323826488704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448784.576423:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba2daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826488704:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.576448:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba2db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826488576:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.576470:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826487936:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.576478:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba2d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826488448:0@lo:400:kworker.0 00010000:00080000:3.0:1788448784.576486:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba2d8000 x1875323826488960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448784.576494:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba2d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826488960:0@lo:400:kworker.0 00000100:00100000:3.0:1788448784.576502:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba2d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826488832:0@lo:400:kworker.0 00000040:00080000:2.0:1788448784.577256:0:23467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788448784.577460:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826487552 00000100:00100000:1.0:1788448784.577467:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826487552 00000100:00100000:1.0:1788448784.577505:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826488064 00000100:00100000:1.0:1788448784.577516:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826488064 00000100:00100000:1.0:1788448784.577533:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788448784.577539:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826487552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448784.577588:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826487552:12345-0@lo:400:kworker.0 Request processed in 49us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448784.577594:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788448784.577605:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788448784.577611:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826488064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448784.577631:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826488064:12345-0@lo:400:kworker.0 Request processed in 20us (2633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448784.577636:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788448784.577651:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448784.577655:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448784.577658:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448784.577660:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448784.577680:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826487552:0@lo:400:kworker.0 00000100:00100000:1.0:1788448784.577690:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826488064:0@lo:400:kworker.0 00000100:00100000:0.0:1788448784.578200:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448784.578214:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826489088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448784.578258:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448784.578293:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826489088 00000100:00100000:0.0:1788448784.578297:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826489088 00000100:00100000:0.0:1788448784.578342:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448784.578349:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826489088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448784.578369:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788448784.578401:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826489088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448784.578408:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448784.578450:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826489088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448784.578777:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448784.578787:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19ed07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826489344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448784.578825:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448784.578852:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826489344 00000100:00100000:1.0:1788448784.578856:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826489344 00000100:00100000:1.0:1788448784.578902:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788448784.578910:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826489344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448784.578921:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788448784.578954:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826489344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448784.578971:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788448784.579004:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19ed07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826489344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448784.579020:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448784.579026:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826489216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448784.579049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448784.579071:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826489216 00000100:00100000:1.0:1788448784.579074:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826489216 00000100:00100000:1.0:1788448784.579095:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788448784.579101:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826489216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448784.579111:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788448784.579140:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826489216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448784.579146:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788448784.579184:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826489216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448784.594191:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.595422:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801207168 00000100:00100000:0.0:1788448784.595451:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801207168 00000100:00100000:0.0:1788448784.595516:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:0.0:1788448784.595528:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+19:18730:x1875323801207168:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448784.595551:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448784.595805:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8057d8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0c9f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.595960:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8057df lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.595981:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8057df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.595993:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8057df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448784.596006:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788448784.596102:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8057d8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c9f expref: 22 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.596120:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8057df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c9f expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.596129:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:0.0:1788448784.596132:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448784.596135:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330000, rc 0) 00000100:00100000:0.0:1788448784.596245:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+21:18730:x1875323801207168:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 719us (2064us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788448784.596253:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:3.0:1788448784.605158:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448784.605286:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448784.605544:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801207424 00000100:00100000:1.0:1788448784.605559:0:25742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801207424 00000100:00100000:1.0:1788448784.605639:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:1.0:1788448784.605650:0:25742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+21:2398:x1875323801207424:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448784.605667:0:25742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448784.605699:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8057df lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c9f expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.605717:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:1.0:1788448784.605721:0:25742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448784.605781:0:25742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+20:2398:x1875323801207424:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 133us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448784.605801:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:2.0:1788448784.607406:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801207296 00000100:00100000:2.0:1788448784.607421:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801207296 00000100:00100000:2.0:1788448784.607549:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:2.0:1788448784.607562:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+20:18730:x1875323801207296:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:2.0:1788448784.607640:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.607659:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.607671:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.607733:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.607740:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ed lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.607748:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.607754:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448784.607759:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.607767:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ed lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.607780:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:2.0:1788448784.607783:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448784.607787:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ed lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.607795:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8057ed lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448784.607902:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+20:18730:x1875323801207296:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 342us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448784.607910:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:3.0:1788448784.610547:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.610640:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801207680 00000100:00100000:0.0:1788448784.610651:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801207680 00000100:00100000:0.0:1788448784.610720:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1788448784.610731:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+20:18730:x1875323801207680:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1788448784.611041:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+21:18730:x1875323801207680:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 310us (507us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788448784.611050:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00010000:00010000:2.0:1788448784.830562:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448784.883572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.883772:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801207936 00000100:00100000:0.0:1788448784.883804:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801207936 00000100:00100000:0.0:1788448784.883946:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:0.0:1788448784.883961:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+21:18762:x1875323801207936:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:0.0:1788448784.883995:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448784.884023:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8057f4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0ca6 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.884169:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8057fb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.884187:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8057fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.884202:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8057fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448784.884215:0:22710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788448784.884404:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8057f4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ca6 expref: 24 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.884440:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8057fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ca6 expref: 23 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.884452:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:0.0:1788448784.884456:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448784.884460:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330000, rc 0) 00000100:00100000:0.0:1788448784.884549:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+23:18762:x1875323801207936:12345-192.168.206.21@tcp:101:cat.0 Request processed in 591us (992us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788448784.884557:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:3.0:1788448784.890015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448784.890099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.890226:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801208320 00000100:00100000:0.0:1788448784.890239:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801208320 00000100:00100000:0.0:1788448784.890327:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1788448784.890340:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+23:18762:x1875323801208320:12345-192.168.206.21@tcp:35:cat.0 00000100:00100000:0.0:1788448784.890701:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+24:18762:x1875323801208320:12345-192.168.206.21@tcp:35:cat.0 Request processed in 361us (598us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1788448784.890709:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:1.0:1788448784.890978:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801208064 00000100:00100000:1.0:1788448784.890983:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801208064 00000100:00100000:1.0:1788448784.891030:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:1.0:1788448784.891038:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba2d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+24:2399:x1875323801208064:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448784.891051:0:22695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448784.891080:0:22695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8057fb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ca6 expref: 24 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448784.891102:0:22695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:1.0:1788448784.891108:0:22695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448784.891132:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba2d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+23:2399:x1875323801208064:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 95us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448784.891139:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:1.0:1788448784.970728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.970946:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801208576 00000100:00100000:0.0:1788448784.970959:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801208576 00000100:00100000:0.0:1788448784.971105:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:0.0:1788448784.971118:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+23:18768:x1875323801208576:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788448784.971160:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448784.971188:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b805809 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0cad expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.971349:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b805810 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.971364:0:22711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8057ae lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c8a expref: 24 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.971372:0:22711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c91 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.971381:0:22711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b805810 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.971446:0:22711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c91 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.971478:0:22711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c91 expref: 24 pid: 22711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448784.971494:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22711:1875323826489472:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448784.971608:0:22711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8057ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c8a expref: 24 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448784.971618:0:22711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8057ae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c8a expref: 24 pid: 22710 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448784.971627:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22711:1875323826489600:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448784.971652:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc19222f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448784.977977:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22711:1875323826489472:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448784.980170:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448784.981391:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22711:1875323826489600:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448784.981454:0:22711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b805810 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448784.982468:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801208704 00000100:00100000:3.0:1788448784.982481:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801208704 00010000:00010000:3.0:1788448784.982538:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c91 expref: 25 pid: 22711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448784.985052:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:2.0:1788448784.985073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448784.985084:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+25:2399:x1875323801208704:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448784.985114:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448784.985127:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c91 expref: 25 pid: 22711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.985144:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c91 expref: 25 pid: 22711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.985170:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8057c3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c91 expref: 25 pid: 22711 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.985191:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:3.0:1788448784.985196:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b805810 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.985206:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b805810 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448784.985214:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448784.985300:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+24:2399:x1875323801208704:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 236us (5146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448784.985310:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:2.0:1788448784.997973:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801208832 00000100:00100000:2.0:1788448784.998019:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801208832 00010000:00010000:2.0:1788448784.998106:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8057ae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c8a expref: 24 pid: 22710 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448784.998162:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:2.0:1788448784.998174:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1aebe6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+24:2399:x1875323801208832:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448784.998193:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448784.998201:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8057ae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c8a expref: 24 pid: 22710 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.998217:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8057ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c8a expref: 24 pid: 22710 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.998245:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8057ae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0c8a expref: 24 pid: 22710 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.998268:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:2.0:1788448784.998274:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b805810 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.998284:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b805810 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.998292:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b805810 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.998327:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448784.998408:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1aebe6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+23:2399:x1875323801208832:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 235us (13338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448784.998440:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00010000:00010000:2.0:1788448784.998528:0:22711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b805810 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.998537:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b805810 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448784.998559:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788448784.998751:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b805809 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cad expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.998776:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b805810 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cad expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448784.998784:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:2.0:1788448784.998786:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788448784.998789:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331600, rc 0) 00000100:00100000:2.0:1788448784.998815:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+23:18768:x1875323801208576:12345-192.168.206.21@tcp:101:dd.0 Request processed in 27701us (28102us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788448784.998823:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:0.0:1788448785.003855:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.003942:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801208960 00000100:00100000:2.0:1788448785.003956:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801208960 00000100:00100000:2.0:1788448785.004041:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:2.0:1788448785.004054:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+23:18768:x1875323801208960:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788448785.004086:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448785.004112:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254e00/0xf45a9e4e6b80581e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0cb4 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.004184:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255a00/0xf45a9e4e6b805825 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.004201:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255a00/0xf45a9e4e6b805825 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.004215:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255a00/0xf45a9e4e6b805825 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.006213:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254e00/0xf45a9e4e6b80581e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cb4 expref: 25 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.006248:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255a00/0xf45a9e4e6b805825 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cb4 expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.006259:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:2.0:1788448785.006263:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788448785.006267:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1b5255a00, rc 0) 00000100:00100000:2.0:1788448785.006369:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+24:18768:x1875323801208960:12345-192.168.206.21@tcp:101:dd.0 Request processed in 2315us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448785.006379:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:2.0:1788448785.009235:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448785.009489:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801209216 00000100:00100000:3.0:1788448785.009501:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801209216 00000100:00100000:3.0:1788448785.009573:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:3.0:1788448785.009585:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+24:18768:x1875323801209216:12345-192.168.206.21@tcp:36:dd.0 00010000:00010000:0.0:1788448785.011482:0:25156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.011512:0:25156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.011526:0:25156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788448785.011623:0:25156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788448785.011661:0:25156:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9ec2a65 reply state 000000002410a670 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.011677:0:25156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.011687:0:25156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:0.0:1788448785.011690:0:25156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788448785.011694:0:25156:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448785.013042:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+27:18768:x1875323801209216:12345-192.168.206.21@tcp:36:dd.0 Request processed in 3446us (3808us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788448785.013056:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00000020:00080000:0.0:1788448785.013065:0:25156:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788448785.016787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.016948:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801209344 00000100:00100000:2.0:1788448785.016961:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801209344 00000100:00100000:2.0:1788448785.017044:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:2.0:1788448785.017057:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+27:18768:x1875323801209344:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788448785.017086:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448785.017130:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b805833 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0cbb expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.017212:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b805833 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cbb expref: 28 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.017229:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b805833 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cbb expref: 28 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.017251:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:2.0:1788448785.017255:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448785.017260:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1b5255200, rc 0) 00000100:00100000:2.0:1788448785.019975:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+28:18768:x1875323801209344:12345-192.168.206.21@tcp:101:dd.0 Request processed in 2892us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448785.019992:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:0.0:1788448785.038529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.038762:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801209600 00000100:00100000:2.0:1788448785.038775:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801209600 00000100:00100000:2.0:1788448785.038860:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:2.0:1788448785.038873:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+28:18768:x1875323801209600:12345-192.168.206.21@tcp:103:dd.0 00010000:00010000:2.0:1788448785.038931:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448785.039055:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b805833 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cbb expref: 28 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.039080:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:2.0:1788448785.039085:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448785.039556:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+27:18768:x1875323801209600:12345-192.168.206.21@tcp:103:dd.0 Request processed in 682us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448785.039567:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:1.0:1788448785.042295:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.046051:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801209728 00000100:00100000:2.0:1788448785.046073:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801209728 00000100:00100000:2.0:1788448785.046319:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:2.0:1788448785.046350:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+27:18768:x1875323801209728:12345-192.168.206.21@tcp:58:dd.0 00010000:00010000:2.0:1788448785.046521:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.046543:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.046557:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448785.050773:0:22712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448785.050814:0:22712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788448785.051037:0:22712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788448785.051392:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+27:18768:x1875323801209728:12345-192.168.206.21@tcp:58:dd.0 Request processed in 5036us (9105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448785.051406:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:2.0:1788448785.056229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448785.056497:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801209856 00000100:00100000:0.0:1788448785.056518:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801209856 00000100:00100000:0.0:1788448785.056593:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:0.0:1788448785.056606:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+27:18768:x1875323801209856:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788448785.056630:0:25156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448785.056655:0:25156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b805841 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0cc2 expref: -99 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.056723:0:25156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.056751:0:25156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b805841 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cc2 expref: 28 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.056774:0:25156:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.056789:0:25156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b805841 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cc2 expref: 28 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.056806:0:25156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:0.0:1788448785.056810:0:25156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448785.056815:0:25156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b805841 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cc2 expref: 28 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.056823:0:25156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331a00, rc 0) 00000100:00100000:0.0:1788448785.056945:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+28:18768:x1875323801209856:12345-192.168.206.21@tcp:101:dd.0 Request processed in 341us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448785.056954:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 48 00000040:00080000:2.0:1788448785.279898:0:22746:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788448785.279910:0:22746:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448785.279979:0:22746:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788448785.279990:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788448785.280179:0:22746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22746:1875323826489728:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788448785.280290:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18770a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788448785.284521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448785.284712:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801209984 00000100:00100000:0.0:1788448785.284725:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801209984 00000100:00100000:3.0:1788448785.284778:0:22746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22746:1875323826489728:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788448785.284804:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:0.0:1788448785.284816:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+28:18769:x1875323801209984:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788448785.284856:0:22711:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788448785.285040:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+28:18769:x1875323801209984:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 225us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448785.285048:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:0.0:1788448785.296404:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.305224:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801210112 00000100:00100000:2.0:1788448785.305243:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801210112 00000100:00100000:2.0:1788448785.305491:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:2.0:1788448785.305505:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+28:18769:x1875323801210112:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788448785.305597:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b805848 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.305633:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b805848 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.305648:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b805848 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.314904:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b80584f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.314928:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b80584f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.314942:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b80584f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.314979:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b805856 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.314989:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b805856 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.314997:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b805856 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448785.315053:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788448785.315058:0:22712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448785.315077:0:22712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b805856 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315090:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b805848 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315114:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b805848 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315124:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b805848 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315131:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5254a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448785.315136:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b805848 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315144:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b805848 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315161:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc08336bb00) 00010000:00010000:2.0:1788448785.315165:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448785.315170:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b805848 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315176:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b805848 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315191:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b80584f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315197:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b80584f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315202:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b80584f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315207:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448785.315216:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b80584f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315223:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b80584f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315944:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9fc1ba209d00) 00010000:00010000:2.0:1788448785.315950:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448785.315955:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b80584f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315963:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b80584f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315983:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b805856 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315990:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b805856 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.315996:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b805856 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.316002:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448785.316006:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b805856 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.316012:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b805856 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.316019:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:2.0:1788448785.316022:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448785.316034:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b805856 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.316041:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b805856 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448785.316149:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+28:18769:x1875323801210112:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 Request processed in 10642us (19754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448785.316159:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:1.0:1788448785.326308:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448785.327583:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801210368 00000100:00100000:0.0:1788448785.327602:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801210368 00000100:00100000:0.0:1788448785.327703:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:0.0:1788448785.327717:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+28:18769:x1875323801210368:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448785.327744:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448785.327771:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80585d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0cc9 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.327949:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b805864 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.327968:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b805864 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.327982:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b805864 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448785.327995:0:22710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788448785.328106:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b805864 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.328114:0:22710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b805864 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.328295:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b805864 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.328313:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448785.328319:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b805864 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.328350:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b805864 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.328366:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:0.0:1788448785.328370:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788448785.328375:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b805864 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.328381:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b805864 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.328563:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80585d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cc9 expref: 30 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.328576:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc08336bb00) 00010000:00010000:0.0:1788448785.328579:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448785.328583:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80585d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cc9 expref: 30 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.328594:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331800, rc 0) 00000100:00100000:0.0:1788448785.328689:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+29:18769:x1875323801210368:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 974us (2406us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1788448785.328699:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:3.0:1788448785.334957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.335140:0:25612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801210496 00000100:00100000:2.0:1788448785.335153:0:25612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801210496 00000100:00100000:2.0:1788448785.335235:0:25612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:2.0:1788448785.335248:0:25612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+29:18769:x1875323801210496:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788448785.335293:0:25612:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788448785.335465:0:25612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+29:18769:x1875323801210496:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 218us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448785.335473:0:25612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:1.0:1788448785.339115:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448785.339321:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801210752 00000100:00100000:3.0:1788448785.339334:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801210752 00000100:00100000:3.0:1788448785.339409:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:3.0:1788448785.339431:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+29:18769:x1875323801210752:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448785.339459:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448785.339485:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b805872 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0cd0 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448785.340020:0:22712:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:3.0:1788448785.340029:0:22712:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:3.0:1788448785.340053:0:22712:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1788448785.340250:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e374800/0xf45a9e4e6b805879 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.340269:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e374800/0xf45a9e4e6b805879 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.340282:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e374800/0xf45a9e4e6b805879 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.340375:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b805872 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cd0 expref: 32 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.340397:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e374800/0xf45a9e4e6b805879 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cd0 expref: 31 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.340407:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc1bb42a500) 00010000:00010000:3.0:1788448785.340410:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448785.340414:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc19e374800, rc 0) 00000100:00100000:3.0:1788448785.340512:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+31:18769:x1875323801210752:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1091us (1410us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1788448785.340521:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:1.0:1788448785.344378:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.346230:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801211008 00000100:00100000:2.0:1788448785.346251:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801211008 00000100:00100000:2.0:1788448785.346346:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:2.0:1788448785.346359:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+31:18769:x1875323801211008:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788448785.346450:0:22711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448785.346484:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e374800/0xf45a9e4e6b805879 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cd0 expref: 31 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346509:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc1bb42a500) 00010000:00010000:2.0:1788448785.346522:0:22711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448785.346552:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b805887 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346586:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b805887 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346597:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b805887 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346617:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b80588e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x84aa6cf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346625:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b80588e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x84aa6cf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346631:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b80588e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x84aa6cf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346695:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b805887 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346703:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b805887 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346711:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b805887 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346717:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448785.346722:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b805887 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346731:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b805887 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346739:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc1ba209300) 00010000:00010000:2.0:1788448785.346748:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448785.346754:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b805887 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346760:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255e00/0xf45a9e4e6b805887 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346773:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b80588e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x84aa6cf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346779:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b80588e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x84aa6cf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346786:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b80588e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x84aa6cf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346791:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5254a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448785.346794:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b80588e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x84aa6cf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346800:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b80588e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x84aa6cf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346808:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x84aa6cf8 (ffff9fc1ba209d00) 00010000:00010000:2.0:1788448785.346811:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448785.346814:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b80588e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x84aa6cf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.346820:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254a00/0xf45a9e4e6b80588e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x84aa6cf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448785.347181:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+30:18769:x1875323801211008:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 822us (2816us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788448785.347196:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:2.0:1788448785.349716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448785.349813:0:25156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801211136 00000100:00100000:0.0:1788448785.349825:0:25156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801211136 00000100:00100000:0.0:1788448785.349930:0:25156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:0.0:1788448785.349942:0:25156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+30:18769:x1875323801211136:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448785.349986:0:25156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448785.350015:0:25156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b805895 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0cd7 expref: -99 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.350073:0:25156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b80589c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.350088:0:25156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b80589c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.350100:0:25156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b80589c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.350242:0:25156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b805895 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cd7 expref: 32 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.350265:0:25156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b80589c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cd7 expref: 31 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.350275:0:25156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc189117300) 00010000:00010000:0.0:1788448785.350278:0:25156:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448785.350282:0:25156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330c00, rc 0) 00000100:00100000:0.0:1788448785.350357:0:25156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+31:18769:x1875323801211136:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 418us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448785.358442:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.359728:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801211392 00000100:00100000:2.0:1788448785.359745:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801211392 00000100:00100000:2.0:1788448785.359870:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:2.0:1788448785.359902:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+32:18769:x1875323801211392:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788448785.360007:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.360027:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.360041:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448785.360268:0:22710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1788448785.360279:0:22710:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702705396745ns, next at 703705393595ns, rc = 0 00000004:00010000:2.0:1788448785.360353:0:22710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d301a859 reply state 000000007584f247 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.360368:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.360376:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc189117300) 00010000:00010000:2.0:1788448785.360379:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788448785.360384:0:22710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448785.360526:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+34:18769:x1875323801211392:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 644us (2106us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788448785.360535:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:0.0:1788448785.362498:0:25156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:3.0:1788448785.364273:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448785.376246:0:25612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801211520 00000100:00100000:1.0:1788448785.376267:0:25612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801211520 00000100:00100000:1.0:1788448785.377368:0:25612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:1.0:1788448785.377385:0:25612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+33:18769:x1875323801211520:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448785.377417:0:25612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448785.377473:0:25612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8058aa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0cde expref: -99 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.377552:0:25612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8058aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cde expref: 34 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.377570:0:25612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8058aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cde expref: 34 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.377594:0:25612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc189117300) 00010000:00010000:1.0:1788448785.377598:0:25612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448785.377602:0:25612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd800, rc 0) 00000100:00100000:1.0:1788448785.377682:0:25612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+34:18769:x1875323801211520:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 301us (13423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448785.377690:0:25612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:2.0:1788448785.385599:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448785.386150:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801211648 00000100:00100000:0.0:1788448785.386163:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801211648 00000100:00100000:0.0:1788448785.386235:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:0.0:1788448785.386247:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1a533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2398:x1875323801211648:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788448785.386573:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1a533d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:2398:x1875323801211648:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 327us (988us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788448785.386581:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1788448785.394826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.394940:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801211904 00000100:00100000:2.0:1788448785.394953:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801211904 00000100:00100000:2.0:1788448785.395026:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:2.0:1788448785.395038:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+34:18769:x1875323801211904:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788448785.395467:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+35:18769:x1875323801211904:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 429us (654us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788448785.395477:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:2.0:1788448785.399151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448785.399322:0:25612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801212160 00000100:00100000:1.0:1788448785.399336:0:25612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801212160 00000100:00100000:1.0:1788448785.399416:0:25612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:1.0:1788448785.399439:0:25612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+35:18769:x1875323801212160:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788448785.399607:0:25612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+35:18769:x1875323801212160:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 171us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448785.399616:0:25612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:3.0:1788448785.403058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.403238:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801212288 00000100:00100000:2.0:1788448785.403252:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801212288 00000100:00100000:2.0:1788448785.403328:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:2.0:1788448785.403341:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+35:18769:x1875323801212288:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448785.403366:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448785.403392:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254e00/0xf45a9e4e6b8058b1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0ce5 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.403495:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8058b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.403514:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8058b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.403527:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8058b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448785.403940:0:22710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448785.403966:0:22710:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8058b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.404022:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254e00/0xf45a9e4e6b8058b1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ce5 expref: 37 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.404046:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8058b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ce5 expref: 36 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.404056:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc189117300) 00010000:00010000:2.0:1788448785.404059:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788448785.404063:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1b5255c00, rc 0) 00000100:00100000:2.0:1788448785.404647:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+36:18769:x1875323801212288:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1304us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448785.404658:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:2.0:1788448785.411980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448785.412058:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801212416 00000100:00100000:1.0:1788448785.412072:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801212416 00000100:00100000:1.0:1788448785.412244:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:1.0:1788448785.412259:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+6:2398:x1875323801212416:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448785.412309:0:24766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448785.412337:0:24766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b8058bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0cec expref: -99 pid: 24766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448785.412371:0:24766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a999011, blocks: 0x0 00010000:00010000:1.0:1788448785.412397:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=702s v=(0 0) 00010000:00010000:1.0:1788448785.412403:0:24766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448785.412415:0:24766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b8058bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cec expref: 7 pid: 24766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.412449:0:24766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b8058bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cec expref: 7 pid: 24766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.412468:0:24766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fdc00, rc 0) 00000100:00100000:1.0:1788448785.412544:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:2398:x1875323801212416:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 289us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448785.412552:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:3.0:1788448785.419141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.419617:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801212672 00000100:00100000:2.0:1788448785.419631:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801212672 00000100:00100000:2.0:1788448785.419700:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:2.0:1788448785.419711:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+36:18769:x1875323801212672:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788448785.419843:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+36:18769:x1875323801212672:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 133us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448785.419851:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:3.0:1788448785.423377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448785.423472:0:25612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801212800 00000100:00100000:1.0:1788448785.423484:0:25612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801212800 00000100:00100000:1.0:1788448785.423610:0:25612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:1.0:1788448785.423623:0:25612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+36:18769:x1875323801212800:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788448785.431298:0:22690:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1788448785.431328:0:22690:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788448785.431398:0:22690:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1788448785.431725:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431741:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431750:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431758:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5254200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448785.431764:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431791:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431813:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fc1ba209600) 00010000:00010000:3.0:1788448785.431817:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448785.431823:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431831:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254200/0xf45a9e4e6b8056f8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431857:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431864:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431869:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431874:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5254000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448785.431877:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431953:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431962:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc1ba209300) 00010000:00010000:3.0:1788448785.431965:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448785.431968:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431982:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5254000/0xf45a9e4e6b8056ff lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.431999:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432006:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432013:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432019:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448785.432022:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432029:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432037:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fc189117e00) 00010000:00010000:3.0:1788448785.432040:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448785.432043:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432049:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8057a7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432068:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432075:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432092:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432098:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448785.432101:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432107:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432116:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:3.0:1788448785.432184:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448785.432189:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432195:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80582c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432209:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432283:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432289:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432294:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448785.432298:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432315:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432326:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc189117300) 00010000:00010000:3.0:1788448785.432328:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788448785.432331:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.432337:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255000/0xf45a9e4e6b8058a3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.433017:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.433029:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.433035:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.433041:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448785.433045:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.433051:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.433062:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fc1ba209300) 00010000:00010000:0.0:1788448785.433064:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788448785.433068:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.433073:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b80574c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448785.433311:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19ed06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826489856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788448785.433556:0:25612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+15:18769:x1875323801212800:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 Request processed in 9800us (10058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448785.433570:0:25612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:2.0:1788448785.436711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448785.438967:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826489856 00000100:00100000:2.0:1788448785.438988:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826489856 00000100:00100000:2.0:1788448785.439075:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448785.439088:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826489856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788448785.439295:0:24219:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788448785.439299:0:24219:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788448785.439301:0:24219:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788448785.439303:0:24219:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788448785 -> 1788448785 00002000:00010000:2.0:1788448785.439306:0:24219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788448785.439400:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875323826489856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 315us (2700us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788448785.439408:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:1.0:1788448785.439724:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc19ed06d80/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788448785.439752:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19ed06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826489856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788448785.444642:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.451794:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801212928 00000100:00100000:2.0:1788448785.451817:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801212928 00000100:00100000:3.0:1788448785.452202:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:3.0:1788448785.452227:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:2400:x1875323801212928:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788448785.452384:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:2400:x1875323801212928:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 Request processed in 170us (7754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448785.452392:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:1.0:1788448785.457201:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.459180:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801213184 00000100:00100000:2.0:1788448785.459199:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801213184 00000100:00100000:3.0:1788448785.463240:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:3.0:1788448785.463260:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+15:18769:x1875323801213184:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788448785.463336:0:22710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448785.463372:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255c00/0xf45a9e4e6b8058b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ce5 expref: 15 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.463397:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc189117300) 00010000:00010000:3.0:1788448785.463403:0:22710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448785.464378:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8058c6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.464418:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8058c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.464547:0:22710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8058c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448785.464728:0:22710:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000018d9dbf reply state 00000000d958631e transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8058c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.464742:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375400/0xf45a9e4e6b8058c6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.464750:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc189117300) 00010000:00010000:3.0:1788448785.464753:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448785.464757:0:22710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448785.465784:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+16:18769:x1875323801213184:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 2516us (8587us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788448785.465798:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:0.0:1788448785.480355:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448785.480553:0:24766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801213312 00000100:00100000:1.0:1788448785.480566:0:24766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801213312 00000100:00100000:1.0:1788448785.480640:0:24766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:1.0:1788448785.480652:0:24766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:2398:x1875323801213312:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788448785.480871:0:24766:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788448785.480875:0:24766:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788448784 00002000:00010000:1.0:1788448785.480878:0:24766:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788448784 00002000:00010000:1.0:1788448785.481174:0:24766:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788448785 -> 1788448784 00002000:00010000:1.0:1788448785.481177:0:24766:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788448785.481358:0:24766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+8:2398:x1875323801213312:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 705us (1016us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788448785.481367:0:24766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:0.0:1788448785.496406:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448785.502676:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801213440 00000100:00100000:1.0:1788448785.502700:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801213440 00000100:00100000:1.0:1788448785.502856:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:1.0:1788448785.502871:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+8:2399:x1875323801213440:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788448785.502963:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd0e892a/0xf45a9e4e6b8058cd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.502985:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448785.502990:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448785.502997:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd0e892a/0xf45a9e4e6b8058cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.503041:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd0e892a/0xf45a9e4e6b8058cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.503075:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dd0e892a/0xf45a9e4e6b8058cd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.503085:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd0e892a/0xf45a9e4e6b8058cd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.503094:0:24220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd0e892a/0xf45a9e4e6b8058cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.503101:0:24220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448785.503107:0:24220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd0e892a/0xf45a9e4e6b8058cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.503117:0:24220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd0e892a/0xf45a9e4e6b8058cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.503148:0:24220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd0e892a/0xf45a9e4e6b8058cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.503156:0:24220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd0e892a/0xf45a9e4e6b8058cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448785.503294:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+8:2399:x1875323801213440:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 Request processed in 425us (7004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448785.503312:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:3.0:1788448785.511295:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448785.511788:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801213696 00000100:00100000:0.0:1788448785.511820:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801213696 00000100:00100000:0.0:1788448785.511931:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:0.0:1788448785.511945:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+16:18769:x1875323801213696:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788448785.512057:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.512078:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255a00/0xf45a9e4e6b805825 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cb4 expref: 16 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.512089:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.512134:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255a00/0xf45a9e4e6b805825 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cb4 expref: 16 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.512150:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255a00/0xf45a9e4e6b805825 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cb4 expref: 16 pid: 22712 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448785.512168:0:22712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22712:1875323826489984:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448785.512272:0:22712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc19222f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448785.514227:0:22712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22712:1875323826489984:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448785.514261:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448785.517771:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448785.518094:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801213824 00000100:00100000:1.0:1788448785.518107:0:25742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801213824 00010000:00010000:1.0:1788448785.518162:0:25742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255a00/0xf45a9e4e6b805825 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cb4 expref: 17 pid: 22712 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448785.518213:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:1.0:1788448785.518225:0:25742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+17:2398:x1875323801213824:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448785.518245:0:25742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448785.518254:0:25742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255a00/0xf45a9e4e6b805825 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cb4 expref: 17 pid: 22712 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.518271:0:25742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255a00/0xf45a9e4e6b805825 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cb4 expref: 17 pid: 22712 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.518308:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255a00/0xf45a9e4e6b805825 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cb4 expref: 17 pid: 22712 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.518329:0:25742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:1.0:1788448785.518336:0:25742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b805841 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cc2 expref: 16 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.518347:0:25742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.518369:0:25742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.518378:0:25742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.518415:0:25742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448785.518498:0:25742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+16:2398:x1875323801213824:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 275us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448785.518517:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00010000:00010000:3.0:1788448785.519168:0:22712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.519180:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.519469:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.519484:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8058aa lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cde expref: 16 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.519501:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.519539:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8058aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cde expref: 16 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.519555:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8058aa lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cde expref: 16 pid: 25612 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448785.519572:0:22712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22712:1875323826490112:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448785.519672:0:22712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0827670c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448785.524789:0:22712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22712:1875323826490112:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448785.524830:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448785.526326:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448785.527076:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801213952 00000100:00100000:3.0:1788448785.527088:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801213952 00010000:00010000:3.0:1788448785.527139:0:22695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8058aa lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cde expref: 17 pid: 25612 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448785.527184:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:3.0:1788448785.527194:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+17:2398:x1875323801213952:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448785.527210:0:22695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448785.527217:0:22695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8058aa lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cde expref: 17 pid: 25612 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.527231:0:22695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8058aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cde expref: 17 pid: 25612 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.527255:0:22695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8058aa lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cde expref: 17 pid: 25612 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.527404:0:22695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc189117300) 00010000:00010000:3.0:1788448785.527411:0:22695:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.527432:0:22695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.527440:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.527511:0:22695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448785.527591:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+16:2398:x1875323801213952:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 395us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448785.527600:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00010000:00010000:0.0:1788448785.532771:0:22712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.532793:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788448785.534270:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1788448785.534451:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1788448785.534493:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1788448785.534604:0:22712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22712:1875323826490240:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788448785.534701:0:22712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448785.534737:0:22712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0834b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448785.534854:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826490240 00000100:00100000:1.0:1788448785.534864:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826490240 00000100:00100000:1.0:1788448785.535159:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788448785.535171:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22712:x1875323826490240:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788448785.535274:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22712:x1875323826490240:12345-0@lo:1000:mdt00_002.0 Request processed in 106us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448785.535283:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788448785.536183:0:22712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22712:1875323826490240:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788448785.536459:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788448785.536537:0:22712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22712:1875323826490368:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788448785.536594:0:22712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448785.536632:0:22712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc19222fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448785.538285:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826490368 00000100:00100000:1.0:1788448785.538304:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826490368 00000100:00100000:1.0:1788448785.538388:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788448785.538400:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22712:x1875323826490368:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788448785.538754:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22712:x1875323826490368:12345-0@lo:1000:mdt00_002.0 Request processed in 354us (2157us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788448785.538762:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788448785.543573:0:22712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22712:1875323826490368:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788448785.543653:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543667:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543676:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543683:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448785.543689:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543698:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543739:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc189117300) 00010000:00010000:3.0:1788448785.543742:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448785.543748:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543755:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375800/0xf45a9e4e6b8058db lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543797:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543805:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543810:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543815:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448785.543818:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543824:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543833:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:3.0:1788448785.543836:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448785.543844:0:22712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b805841 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cc2 expref: 19 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543856:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b805841 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cc2 expref: 19 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.543873:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b805841 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cc2 expref: 19 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.544305:0:22712:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b805841 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cc2 expref: 19 pid: 25156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448785.544322:0:22712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22712:1875323826490496:192.168.206.21@tcp:105: 00000100:00100000:3.0:1788448785.544496:0:22712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0827676c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448785.549571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448785.549659:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801214080 00000100:00100000:0.0:1788448785.549672:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801214080 00000100:00100000:0.0:1788448785.549741:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:0.0:1788448785.549754:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1aeb54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+20:18768:x1875323801214080:12345-192.168.206.21@tcp:49:dd.0 00000100:00100000:0.0:1788448785.549967:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1aeb54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+20:18768:x1875323801214080:12345-192.168.206.21@tcp:49:dd.0 Request processed in 215us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448785.549975:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:3.0:1788448785.550578:0:22712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22712:1875323826490496:192.168.206.21@tcp:105: 00010000:00010000:3.0:1788448785.550610:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550622:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1b5255200/0xf45a9e4e6b80583a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550663:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375c00/0xf45a9e4e6b8058e2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550682:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375c00/0xf45a9e4e6b8058e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550696:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375c00/0xf45a9e4e6b8058e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550707:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375c00/0xf45a9e4e6b8058e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550713:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375c00/0xf45a9e4e6b8058e2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550742:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375c00/0xf45a9e4e6b8058e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550748:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc19e375c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448785.550753:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375c00/0xf45a9e4e6b8058e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550762:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375c00/0xf45a9e4e6b8058e2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550776:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:3.0:1788448785.550779:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448785.550783:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375c00/0xf45a9e4e6b8058e2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550789:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc19e375c00/0xf45a9e4e6b8058e2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550800:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550807:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550813:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550819:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448785.550822:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550840:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550851:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:3.0:1788448785.550853:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788448785.550856:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.550862:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8058d4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448785.554557:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+19:18769:x1875323801213696:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 42596us (43261us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788448785.554575:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 63 00000020:00080000:2.0:1788448785.554583:0:22712:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788448785.561218:0:22746:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788448785.561231:0:22746:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448785.561254:0:22746:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788448785.561267:0:22746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788448785.561528:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448785.561626:0:25612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801214208 00000100:00100000:1.0:1788448785.561637:0:25612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801214208 00000100:00100000:1.0:1788448785.561700:0:25612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:1.0:1788448785.561740:0:25612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+19:18768:x1875323801214208:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:1.0:1788448785.561766:0:25612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448785.561792:0:25612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8058e9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0cf3 expref: -99 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.561833:0:25612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b8058f0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.561849:0:25612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b8058f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.561862:0:25612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b8058f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.562157:0:25612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b8058e9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cf3 expref: 21 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.562178:0:25612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b8058f0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cf3 expref: 20 pid: 25612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.562188:0:25612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fc189117100) 00010000:00010000:1.0:1788448785.562191:0:25612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788448785.562195:0:25612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fde00, rc 0) 00000100:00100000:1.0:1788448785.562269:0:25612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+20:18768:x1875323801214208:12345-192.168.206.21@tcp:101:dd.0 Request processed in 532us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448785.562278:0:25612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:1.0:1788448785.568948:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448785.569181:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801214464 00000100:00100000:0.0:1788448785.569195:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801214464 00000100:00100000:0.0:1788448785.569257:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1788448785.569283:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ed07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+20:18769:x1875323801214464:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788448785.569618:0:22714:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788448785.569655:0:22714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1788448785.569692:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8058f7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.569711:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8058f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.569724:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8058f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.569734:0:22714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8058f7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.569740:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8058f7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.569747:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8058f7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.569770:0:22714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788448785.569875:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ed07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+22:18769:x1875323801214464:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 592us (939us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788448785.569930:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000020:00080000:0.0:1788448785.569936:0:22714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788448785.570173:0:22698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448785.570182:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8058f7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.570201:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448785.570206:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8058f7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.570214:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8058f7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.570229:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fc189117300) 00010000:00010000:1.0:1788448785.570232:0:22698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788448785.570236:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8058f7 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.570242:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8058f7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448785.570256:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448785.570258:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448785.570260:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448785.599679:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448785.599781:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801214592 00000100:00100000:0.0:1788448785.599794:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801214592 00000100:00100000:0.0:1788448785.600111:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:0.0:1788448785.600127:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+8:2399:x1875323801214592:12345-192.168.206.21@tcp:4:dd.0 00010000:00010000:0.0:1788448785.600196:0:24224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.600221:0:24224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b8058bf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cec expref: 8 pid: 24766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.600230:0:24224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448785.600236:0:24224:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448785.600241:0:24224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.600605:0:24224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b8058bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cec expref: 8 pid: 24766 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.600624:0:24224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b8058bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cec expref: 8 pid: 24766 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448785.600641:0:24224:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24224:1875323826490624:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448785.600788:0:24224:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1a1566a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448785.607833:0:24224:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24224:1875323826490624:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448785.607877:0:24224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448785.613141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448785.613258:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448785.613372:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788448785.613384:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788448785.616977:0:24226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801214720 00000100:00100000:0.0:1788448785.616996:0:24226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801214720 00000100:00100000:2.0:1788448785.617759:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:2.0:1788448785.617778:0:25759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+9:2399:x1875323801214720:12345-192.168.206.21@tcp:4:dd.0 00010000:00010000:2.0:1788448785.617815:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.617837:0:25759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448785.617841:0:25759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448785.617846:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.617856:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448785.622242:0:25742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801214848 00000100:00100000:1.0:1788448785.622264:0:25742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801214848 00010000:00010000:2.0:1788448785.622391:0:25742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b8058bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cec expref: 10 pid: 24766 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448785.622461:0:25742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:2.0:1788448785.622474:0:25742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+10:2399:x1875323801214848:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448785.622490:0:25742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448785.622512:0:25742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b8058bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cec expref: 10 pid: 24766 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.622528:0:25742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b8058bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cec expref: 10 pid: 24766 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.622562:0:25742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b8058bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0cec expref: 10 pid: 24766 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.622580:0:25742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448785.622598:0:25742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448785.622605:0:25742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.622614:0:25742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.622625:0:25742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448785.622627:0:25742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448785.622631:0:25742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.622638:0:25742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.622689:0:25742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448785.622754:0:25742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+9:2399:x1875323801214848:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 283us (9627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448785.622762:0:25742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00010000:00010000:0.0:1788448785.622797:0:25759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.622836:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.622858:0:24224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448785.622871:0:24224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448785.732007:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:1.0:1788448785.732025:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1788448785.733335:0:25759:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1788448785.733342:0:25759:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788448784 -> 1788448785 00002000:00010000:0.0:1788448785.733345:0:25759:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788448784 -> 1788448785 00002000:00010000:0.0:1788448785.733347:0:25759:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1788448785.733367:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.733380:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.733388:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.733395:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1b5255400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448785.733400:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.733409:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.733439:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448785.733461:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea07cf63/0xf45a9e4e6b805905 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448785.733555:0:25759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+7:2399:x1875323801214720:12345-192.168.206.21@tcp:4:dd.0 Request processed in 115765us (120279us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788448785.733565:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00000001:00080000:1.0:1788448785.755324:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1788448785.755619:0:24224:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1788448785.755645:0:24224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.755660:0:24224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.755669:0:24224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.755716:0:24224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330e00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448785.755722:0:24224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.755730:0:24224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.755756:0:24224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448785.755764:0:24224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8058fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448785.755969:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:51dd0700-0e8e-4641-b0ab-f8f57ad4c26b+5:2399:x1875323801214592:12345-192.168.206.21@tcp:4:dd.0 Request processed in 155838us (156295us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788448785.755980:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00010000:00010000:2.0:1788448785.855128:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448786.884069:0:22698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788448787.341115:0:25796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788448787.902480:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448788.161112:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826490752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448788.161190:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448788.161256:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826490752 00000100:00100000:0.0:1788448788.161264:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826490752 00000100:00100000:0.0:1788448788.161339:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788448788.161348:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826490752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788448788.161379:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3908194304 avail 3676672000 00000100:00100000:0.0:1788448788.161445:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826490752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448788.161453:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788448788.161478:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448788.161513:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826490752:0@lo:13:osp-pre-0-1.0 Debug log: 13906 lines, 13906 kept, 0 dropped, 0 bad.